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INTRODUCTION 



Overheard In an airport I imousine— one aftluent young mother to another; 

' ' Government money given to the schools is rather frightening.. One 
• year, all the children In my daughter's school can read. Then^xt 
lyear, government funds are available for reading, and suddenly 50 
percent of the children can't read! What U,: going on? . / " 

•. . That's the questjon-what js going on In the schools? What are the real 
prlorrtles? What are the crtt teal needs?' Who determines them? How do we i 
find out? Where are noM and wliere Are we going? , . ^ 

' Needs assessment acjtual'ly goes back to ancient China, and It .is not t»ew 
on the American educational scene. What is:.neW is the effort , In the last 
decade, to develop conceptual bleeds assessment models, to us^systematlc pro- 
cesses for identifying needs and setting priorities, and to involve the non- 
school community in joint goal-setting and planning efforts with educators and 

Students. ' \ ^ 

The scramble for federal dollars for= categorical aid to schools, Uich has 
been a future of fjuch'school planning since the passage of the Elementary and 
Secondary Education Act of^SfiS, has changed the wles of the educatiorl^l game. 
Schools wishing to apply for grants under the competHlve titles of the Act, 
particularly ESEA, Title III (innovative programs), must Justify their request! 
with comprehensive needs assessment data. State departments of education have 
also received grants to develop models and to perform statewide assessments. 

. This report is intended primarily for educators who have the fespons i b*l I ty 
for conducting or managing a needs assessment at the school site or district level. 



Although most of the material relates to local assessments In the elementary and^ 
secondary schools, some Information has been Included on statewide assessjients 
and on emerging efforts In community colleges and universities. The i^fqfrmatlpn 
was gathered from published and unpublished reports of needs assessments! from 
examination of models, kits', and various Instruments; and from the (llml/ted) then- 
retfcal and research literature In the flel^. f 
The report Is organlzedTjn three parts: ^ r - j 

Part I. The state of the art. An overview of' trends and roajo/- approaches. 

■■/•.■'* 

- • Part H. Needs assessment models. Descriptions of the most widely avail- 
ab)eantf characteristic models, togeiher with' some case studies of ^^helr appll- 



cation. ..^-^ , > / 

■ ^ ^ ' • / / 

. Part III. How to do It. Managing the effort, some communist Ion and ^ther 

strategies, strengths and limitations, and social fairness Issu^. , ^ 

■ ' / ■ " / -f,. . 

SOME (BJEST IONS ANSWERED - ^ / / 

What Is needs assessment? Atsystematlc^focedure for Jinding out where the 
greatest gaps are bkween what learners knwi/and can do, an^ what they should know 

and do. / / - ' 

-^.^^.. 4#tv stwuld I do a needs assessment to make bet te/ dec! s I ons for educa- 

tfonal planning. . To be more accountable to students, parents, and taxpayers. 

' '■ ■> ^. -■ / * ' ■» ■' 

To assign priorities to the greatest areas of need. TOf|toow-how time, people, and 

educational dollars should be used to do the most goed.\,^;' ' 

Wio should do It? Everybody concerned with your educatlonaT systemr-stu|ents 

■ ^ / ■ ^ 1^ ■ 

teachers, other staff, parents, people In your community, business' people, cen^ 

cerned citizens. . /. - { 

How Is It done? There are some general steps that most "aix^erts" /ecommend, 

but there's lots of room for variation. / 

Mwn should It be done? If you haVe never done a comprehensive assessment 

' — T /' ' ■ * • 

before, you might take as mueh as on,«^school year for a good study. . Thereafter, 



/ 

/ 



updates In high priority areas m/ght be done In the spring to lead Into currlcular 

' / ' ' / 

an<*' other planning for the nex^ school year. 

/ Where Is It done? Neec^i assessments are appropriate from preschool through 
^duU education. It can be/done at one school or on one level at a tW, or 
/throughout the whole system. ^ 

50ME CAUTIONS / 

Needs assessme^rt Is here to stay. It can give you a lot of useful Infor- 
mation. In this report you will find descriptions of many different ways of con- 
ducting a needs/ assessment , as well as the advantages and disadvantages of dlf^ 

, / . \ 

ferent approaches.* » ' , 'i 

But a/4>rd of caution Is needed. Some of the most popular methods and t^ie 
easiest /o perform may promise more than they deliver. They may leave the pari 



ticlpan4 with 3 glowing feeling of being really Involved, but the Information \ 
gathered may be superficial and short-sighted. ^ | 

/" On the other hand, other approaches which take more time and seem like a j 
/ot of work may give you better and more reUable Information for decision making 
Only a close comparison of different models will tell you which approach Is'best 
for your school system's needs. 

The question Is: "What Is a need?" _ 

' / - - i- - - - " 

A wish or desire Is not a need. j 

A goal Is not a need. ' j y 



A solution Is not a need. 

What is a need, what to assess and how to assesjs It, will become clearer In 
the chapters that, fol low. 



*Tht models and Instruments referred to throughout this report are ^U"^^^;*';^^^ 
of eu«J«t and emerging approaches. The list Is not all-lncluslve nor are those 
■'['-'■•^XJi^^ Mcluslon.of any modal does not constitute an endorse- 

want of the model or of -akompanylng services. 



CHAPTER 1 • 

* 

' ' ' r'' 

' . WHERE ARE WE NOW AND WHIRE ARE WE GOINGT / 

\ /' 

THE STATE OF THE ART . , 

If you wish to conduct a needs assessment, several' different types of In- 
struments, techniques, and procedures are available. Some have been published 
as complete kits; others are ilmple survey or rating Instruments to asses^ general 
or specific needs. Certain quantitative tefhntques and decision models Mve 
recently been published which hold promlse'for greater precision.. TJi«j4 are also 

.some general models which give guidelines for doing your own assessments, but4 ' 

* . / 

which do not furnish Instruments. . Consulting firms offer services to accompany 

: ,■ , / • ; 

certain of these general models. X 

The>ost conmonly accepted definition of a need Is the difference between 
•Vfhat ls'» and "what should be." Most of the-xldely used models dif lne'*'V»hat s^jouW 
be" as goals of education, of varying degrees' of specificity; and they dlscoyer^ 
"what Js" by aVkIng different peV'e how Well tt^^schools are attaining those / ; J; 
goats. In fact, In the majority of actual cases studied, the needs assessment had 
not progressed past the stage of assigning priorities to a set of general goals 

of education. . ^ 

ThiTgreat spurt of development In? needs assessment Is less than five years 
Old. Few models or instruments have been extensively field tested for validity ^ 
and reliability. Many In wide use have not published research findings. There 
is little evidence that theoretical and posft Ion papers, doctoral dissertations, 
and other university research have had much! Influence on what actually occurs In 



1/ 



1 

the field. 



Promising studies undertaken c6ppef at I vely between university research bureaus 
and state departments of education haveloften been shelved for lack of funds or 
political support. The literature offers many examples of needs assessment efforts 



/ 



that begaf 1.0 ihe framewprk of coraprfeh«nslve models bufvrtllch ended either In a 
stratght^rwardl program of standardized testing or with a public opli^lon survey 

I . • « 

on educational coats. 

.Me^rthele^s, thk Interest In needs assessment at all levels Is high and 
rlslnflJ S6me Instruments are not copyrighted and their widespread use and Bdapta- 
tlon aii encouraged. Whether copyrighted or not, certai,r» basic discrepancy tech- 
olquesL>^e been freely borrowed and adapted by districts, often without acknowl- 
•dgmci^ of the I r. source. . ' 

■4 ■ ' ' 

SOUR& OF INFORMATION ^BOUT EXISTING MODELS/PROCEDURES 

' |/ If you wish a quick overview of how to perforjiia a needs assessment , ^r a com- 
pa/fsoii of different approaches, here are some recent publications: 

EdtumHonal System Planning, by Roger Kaufman y 972. Chapter 3 out- 
lines the major functions and components of needs assessment, and 
pJaces It In the context of system analysis. 

ndeSk iseeament (hdminea A booklet published by^the Ohio State 
Department of Education, i)lvl%lon of Planning and Evaluation. 
Presents eight steps of^a comprehensive needs assessment procedure, 
. with Instructions for Implementation and examples of procedures and , 
reports. / - 



mBd^eBeBBm^t^Edk,Scdion^ ^-1^^ by the New Jersey 

" State Department of Education (Kaplan \$7k) . One, of a series on 

educational planning. Suggests ways of managing an "cessment, sets 
criteria, and summarizes and compares the principal characteristics 
of four different models. - 

' state Eduaatiomt Aeeea^t Progrms. Published by Educational 
/ Testing Service, 1973i Summarizes the assessment '«?«5'%and pro- 
^ cedures of all 50 states,- the District of Columbia, ^l^e Virgin 
Islands, and Puerto ftlco, and compares three kinds of programs. 
A good source of Information on major Issues, such as itieasurlng 
eognttlve and affective achievement, norm- referenced vei-sus crite- 
rion-referenced testing, effect of different financing patterns, 
and major problems of state assessment programs. 

"""ktai^i^* Eduoatiomt Seeds Aeeeeement. Gives an overview of the 
. phtt^s^phUs, metliods, »n6 findings .from the assessments conducted 
by Kehtucky, Mary/land, New Jersey, Pennsylvania, and Vlrglnl^ 
tNershkowltz I97ji). ' 
\ For a list of general or <;omprehensive kits, Instruments, or manuals sult- 
«L for eUmentary, secondary^ or higher education needs assessment, see Appendl 



\ 

\ 

\ 



A. For more limited or spKecletlzed Instruments; see Appendix B, 

TRENW \ 

A major characteristic of most approaches Is that they eitHsloy some system- 
atic method of collecting opinions or other data from many different groups lK~ 
side and outside of education. This trend toward active community Involvement \ 

seems likely to continue and to Increase. * \ 

/ . • \ 

Most of the models and Instruments are oriented t<^ard the present, not the \ 

future. They rely heavily on what educators and cltlzfens think. the schools ought 

/ 

to be doing, -arid their Judgments as to hew well they are doing. They tend not to 

ask the hard questions or to probe very deeply Into educational or social Issues. . 

, " - - " ' / 

Little progress- has been made In validating the public's perceptions of ."*hat 

Is" and more importantly, "what ought to be." , 

However, certain trends A»e emerged within the last couple of years.. One 
Is the use of "futurology" and related techniques to an tjc I pate ''needs In a i4ich 
longer time frame— usual ly to the year 2000. T1fieJeN^opi^tjpil„s^^ 



"^'V^' alternatiw futures, and the use of Delphi studies to aid In pl-annlng whole^new 
school systems, rtay\ell Influence shorter-range needs assessment efforts. (see 

, Chapter's).' \ _ ' \ • 

Another trend i« the development of new technology, such as Faut^t Tree Analy- 
sis, for analyzing the "real" as compared with the "apparent" needs bf a system, 
for tracing causal chains, and for setting prlorltles^on needs 6n the basis ^f 
relative probabilities of occurrence y6ee Chapter 6). Computer programs have also 
Increased the feasibility of using rtulttvartate analyses of data to aid th set- 
ting priorities. 

Still a third trend is that Institutions of higher learning arc-shwtflng a 

* ^ ■ j'' 

strong Interest In needs assessment. Present \lndlc^lbns are that colleges and. 

universities see needs assessment In a somewhat different context from school 

"JJ dlttrlcts or state departments of education. They look to needs of the conmihlty, 

ERIC, . . ' 11 / 
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'ty manpower needs, and to the requirements of professions for the-^eu? of the 
assessment, rather than to discrepancies between expected and. actual' ^rformance 
of students. Monejhetcss, models such as that developed by a consortium of 
Florida conwunlty^ colleges could very weW be used by high schools (see Chapter 

7)". _ . \ ^ 

Re^al an^tnter-lnstltutlo|fl needs asse^nt and planning efforts are 
•., /^^- ^ . ' % ■■ • ' . 

also trends that hold promise. Results from these Studies should be forthcoming 

, ~ X % ' . 

In the next three to five years. ^ \ ^ ^ 

RESEARCH NEEDED. \ 

The field Is markedly and sadly .lacking In 'almost any kind of research on 
the processes of npeds assessment. There Should be \^alldl'ty and reliability 
studies on Instruments, as well as studies of the effects of different assess-, 
ment processes and communication strategies on the educational system. LongI- \ 
tudlnal studies are needed to trace the Impact of i^eeds assessment on^l Icy maklrfg, 



"lirrlcular cha^Torgain National structure, and student performance. Cost/benefit 
comparisons of different approaches are needed. Studies might also be undertaken 

^to tert hypotheses generated by theoretical models, such as Kaufman's unlllty ^ 
continuum (see Chapter 8). 

FUTURE OF NEEDS ASSESSMENT 

The large-scale development of recognizable needs assessment models and their 
Implementation Is still too new to know what th* long-range effects of the pro- 
cess wni be. Many questions remain./ .Were the, W.P%atlons. of completed studies 
ever realized? Are needs being more effectively Vta|ked^han before? What has 
happened to the programs which grew out of^necds a^sessment^ In the early days of 

ESEA, Title III? ' "\' \ 

other questions relate to methodology. l%one ^proach to needs assessment 
/ more valid than another? If a^needs assessment %1 I er largely on people's per- 



captions current status, and those perceptions are based on scanty or Inac- - 
curate Information, what are the conse,quenfee$ for the school dfstrlct? . 

Few developers have shown how to relate such qualitative data as values, 
perceptions, and concerns, to such quantitative data as test Scores, demographic 
data, and transiency and absentee rates. Yet ir technlquesnare widely 

avalTat>1e, educators w.lll assign priorities ma^e decisions using one-dlmen- 
slonal or over-slmpl If led decision rules. '/^^ ' ' 

Still another question Is the role of jfe\rai and state legislation and 
Inte.rventJoA In establishing goals- and program direction for Vocal educational . 
agencies. What has b4ert the %act of the priorities thus established? Hav^ 
other, perhaps more press I ng needs for the long term, been overlooked? For exam- 
pie, some federal and state mandates have stressed reading and coSnltlve ^klFls 
as the major need for program development and funding. What about other needs 
and priorities that may be overlooK^ or sllghtad as a result? Wha^ wlU-be the 
Impact In the future on local' decision making as well as on the educational cort- 
petence of the graduates of the schools? , 

PdWerful eKternal Influences on loijal perceptions pf needs have come from 
requlr«nents for programs under jcategor leal fedej:ar and state funding. It^l.s In 
tWs context that present and future efforts In needs assessment must be eons.ldered 
Because tif legislation, Lpeclal funding, and other external pressures, schools 
*mav be hard pressed to tjake a fresh took at thelr^ goals and their programs. The 
present state of .affal rs encourages fragmentation and constaniT^shli . . In focus as 
ex» hat priorities change. ■ , ;, , " v 

.t/ 1966, when PAC£* -cetiters^ere funded under ESEA, Title III, their\staffs 
^yere advised to'assess the needs of students and the communt^ylantl- to xlevelV inr 
nov^ilve programs to meet those needs. Political realities nipped most of thpse - 



*Prc^'ects to Advance Creativity in Education. 



ef'f^rts the bud; programs were written and currtcular and Institutional changes 
aken-with little or' no systeinatlc assessment of needs. 
Nearly a decide later, we see a renewed Interest In needs assessment, and 
probably more to the point, an Increase In the sophistication and validity of 
the methodology available for accomplishing It. Regardless of the Internal and 
external conditions which have occasioned this interest, needs assessments In 
the contexts of planning, evaluatloo, or accountability will no doubt' continue 
to be an' Important responslbl,! Ity of educational administrators. 



(Chapter 2 



DSFINITIONS AND PURPOSES ^/ 



i < 

\ — 



This chapter elaborates on the first two questions raised in the introduc- 

ti'on: /O) What is needs assessment? (definitions), and (2) Why should It be 

/ - ^ 

done/ (purposes and- advantages) . ^ 
DEFINITIONS 

The nest connonly accepted^ definition of a need is "the measurable discrep- 
ancy between current outcomes and desired or required outcomes" (Kaufman 1972).- 
It has also been cafled. "the dlfference-betwAen 'what Is'" and 'what ought to 
jbfeJ"; "the discrepancy between 'what is' and 'what is required'." 

Neeis assessnent, them, is a systematic or formal procedure for determining: 

' 1. A desired state of affairs-that Is, a ^set of educational goals or - 

other statements about "what ought to be" in the area(5) to be assessed. 

\ 1. The present conditions that exist in that area. 

1 

\ - 3. The kinds and degrees of discrepancy that exist between (1) and '(2). , 
I ' . The reasons or causes f;or the discrepancies, 

\ 5". Which discr^eparicy (need) areai should be given the highest priorities 
\ fdr action. , 

I Needs assessment can be directed 'to learner needs, to institutional needs, 
■ or loth. Although many wri,ters ijisist that the assessment Should be concerned 
onrlwith learner needs, in practice institutional needs are usually tai<en into 
consideration also. 

Learner needs are focused on student -perforrance, typjcal 1y. in basic , ski 1 Is 
or the cognit'ive domain, although f^ny assessnents now 'add the affective and psy 
'cho-ctor do-airs as well. Needs are usually related -to "outcome" goals and ,pb- 
j^ctlves, 

lj^«tJt.tio«a! needs ^o'cus on school olant and other facilities, prograr,- 



staff, and other resources. TheVare also termed process, administrator, or 
supportive needs. Institutional ne^s assessment Is one way of analyzing the;' 
causes of discrepancies revealed In the^^earner-centered assessment. , 



PURPOSES . ' 

• Neetis assessments are undertaken because th^y will give Information that 
wouS^ot be available otherwise! Four major reasons have Influenced schools 

o undertake such assessments: for Improved currlcul^r <)l.annlng, evaluation, 
Lcourjtablllty, and to support applications for federal\f unds for competitive 

piograms. ■ ' ' ^ \ >. \ ^ 

\ Planning . Needs assessment Is usually the first step In contrehenslve pro- ^ 

gram planning. It establishes direction and focus of basic cVfrlcular progrms, 

* ... ' • ' ' ' " i,:- _ 
sets priorltleff for future development, and gives the basis for al^catlng sc«rc«~ 

resources. ' ^ • \ 

; Evaluation . The tjenter for the Study of fvaluatlon at^UCLA considers needl 
assessmetit is a tYpe,of evaluatlon-lndeed, (the first stefrtn evaluation (Klein 

and others 1971). ' . 

N<eds assessment uses some of the same tools as evaluation—test data, re- 
po/ts,^ behavioral Indicators, and observations".. The purposes are different, how- 
ever. Needs assessmetit lii general looks to the future. It asks what should be 
done to Improve educat"lo7nT Evaluation In general looks to the past. It asks 
what has been the Impact of a given prosram on student learning. Evaluation data 
during and at the end of a program may profltabiy be used to assess areas of 
discrepancy which Should be addressed for the coming year. 

AceountabllttV . In the last decade, state; legislatures and local communities 
have demanded that school districts document their needs and provide a rationale 
for the waV that they' spend their funds. 

' There has also been a rising demand for more widespread participation In 

\ ..18 



decision making. Teachers, students, parents, and the gfeneral communfty served 
by the schools want a voice In setting priorities, for programs-and In some case^, 
In saying how those programs should be run. Other social forces^ playing a part 
have been the credibility gap between professional educators and the lay public, 
the antipoverty movement with Its community action groups, and the consumer move- , 
ment, which raised questions of governance and cont.rol. 

jtopllMtlons for federal fundings Title II I of the Elementary and. Secondary 
education Act of 1965, wh:c)» provided competitive funds for Innovative educa- 
Aondl projects, reflulred a comprehensive 'needs assessment to justify the Feqoesis:- 
for new programs.. In many states, supplementary (PACE) centers were set up 
u|ider- the' Act either to perform functions related td certain currlcular areas, 

oi- to become general planning centers. In the latter case, a major function 

' ■■ ' ' ' ' - '' 

^s to design and carry out a systematic assessment of needs for the regions 

served. , . , . 

M California, for example, each of the 21 PACE centers, serving single oj- 
fflultl-cottnty regions, developed madkn of needs assessment and carried out elab- 
orate studies to Identify high priority needs In their areas.. Many of th^ Resent 
nioders grew out of work that was done In those centers In 1966-70. - 

In 1969, the administration of ESEA, Title III funds was delegated ^y the 
U.S. Off Ice of Education to state educational agencies. These agencies were 
then charged with the responsibility of developing models and conducting statewide 

as^esfmisnts. , 

A renewed demand for needs assessment has xome recently with thi advent In . 
some states of requirements for school districts to submit copsdUdated appli- 
cations for federal and state^fundlng. Such' appl I cat Ions must be bafsed on a cdffl-, 
prehenslve needs assessment at each schooLslte (see California's Proposal for^ 
Consol'ldated Planning, 197'»); H.R. 69, which extended the Elementary and Secon- 



^ry fducittmi kct ind coif^trH^ *tt with blltngual educatloii» ady1t\€dueat!oft> 
iM\mn ^(Kattorii and sevarat othar provfsionsp wilt i^ndoubtadty. co5^nua/to 
r^ylra iiaads aasasstnent data In suppoft of thosa appi teat ions whara th^vftiiids; 



a^ai^r^ compat1tI>^ly« 

i \ / -J, ' ■ _ , \ 

I ^ant^Yi Institutions !of highar l^rntng hava racafvad grants fromvTltIi 

Ml of tfta Htghar Iducatlon Act to ccmduct neads assassinants for ton^'fat^nsiv%! 

' r '-'^ \ ' \ - ; 

T)i4 i^rposas of naads assassmants at fagi^a>\and stata adueationat lav^ISi 
^mi liC M#lar ^ycatr^^ win In» dlscussad-ffi CI»ptaf-7. 

f^mfim df ASSESSHENT 

.^?faf.0 tha raasons T^or dofr^ an a'siiassinant sa™.to ^xmm rolnly f rom prefn 
syraf ^ tl^ sctioolf ffc^ i^tst^ sourcaa. tyty yoy mi^aslc^ r%)Aiat*s fnjt ^nj^ 
.si^ttrlt^ Is It wrtti tha bothar will it linpi^ya adycif t<m? 
tf^# ara soma advantagai^ that ot^rs hava fotmd: 

1. Ma program pf^miar y^ wllf discoiw urt^ra thaiafaas of iraatast 
strangth af^ :'WMfaiass mrm An raspact to stitfwt Jaamfi^* thtis Ta^t^ 
* lug tha basis for wora ratl«ial-cyrrlcytar ptannfng* i 
' ^ - ■ ' , ^ ' / _ • ' 

' - %4 Yo^ My find ra^altng dtsorapmoias of varloyf klfitfs mmg tha^par: 
options of aiffarant grm^*-a*.g«i parants^ stydantSt'adycators^ 
^ ^stnass papp1a**as to how wall tha school It parfomilng Itt Job. 

3. Ufiaj^ctad or hiddan itaads fend causas of on|K»lng or unrasolvad 
. problams^my i&mr^.' <^ , 

assafimpnif, If addrassad to fytyra and long^ranga n^s as watt 
, as cyrVanr^s^ wftt^provlda for ran^t In tha school/ 

§. Mmti mNids assassmant data al-a ys^ In conjimetlon with data on 
^st/affactlvaMss and ava I i^tli^t yoy can mora daf iMistbIa 
chotcfs Msnf progrM attarratlvas. A mth^lcal approach pra* 
vimtsjfaaptng to sotytlons on thif basis of scanty anftysls or 
avIdaiVca* . 

1. ^ttds aiMStmnt shouM also 9ty« im dtrectfon for placing pff- 
V^^^^^fT^M on a1 toting tearea rateurcai. 

,f.; ..>' • /yf'^llHan dona succaailvaly war »<o or thrwi yaara, tha •tstttnant 
X ' 0 7 trill fhoM trends ralatad to tneraastng, daellning, or ehaAgtng 

fRiC; IS"; " ■/ „ .;, : . 

, _ • . , . - _ . _ * . ' ' _-. Wilis'. 






^ ' pupil populations. 

. 8. Should you face decreeslng public support for education, dropping 
~ enroHments, and deifiands for letter performance of high school 
graduates, a good needs assessment will help you find the cjiuses 
• of the-^lff Icultles and set priorities for corrective action. The 
assessment wit.], el ther„ uncover tmi Information, or dott^ient and 
validata policies and prograwj^lready In action* • - 

9; M4^s assessments will also give you inforraatlon for. planning In 
^I^rtar^areas, such/^1 adHatton of the handicapped, health and 
, guidance services, ^^career. «Wi vocational education, nwsds of 
Blflorlty/i.angi«ige and cultural groups, and multicultural educa- 
tion for/ all. . " ' , 

to. i*en you Involve tl» c«swinlty In the process, y«Hi are lllosly to 
flnd'^dl acceptancfi for the suiting plans and policies thaH 
if ed^^^rs alone hsi^ the m^s mi maks tha declstonf . 
Also, ^tm\ dlssldenlE as k»I'1 as supportive groups are given a , 
voice, a^ their pak-ttci^tlon Is Invited in a constructive 
^JaShlon.y there Is a bettor cMn^ of reaching ^sensus on the 
ai^s of greatest weed and on pro^als to meet those ne^s. 

- OiJ^tions to performing ne^s assesMients have sometimes been rais^ on 
the gro^s tttat educators already know what the ne«ls are, that the process Is, 
tlme-conswlife, that there niiy h^^ unWel«>me repercussions from the public or 
fr^^tud^ts, or thatvirevibus^assessmwita turned up problems which have not 

yet be«i solved. / j 

If pr'lous studies not result In the changes desired. It might be for 
any of the following reasons? (I) the data were not acted upon, (2) conditions 
In the school or the envlronj«ntJwve ^hans»d,.and further assessment should be 
d«w; or (3) changes were actually iwide, but were' not documented or publicised. 
Aftnatlves to need's assessment In the past have been: conventional wisdom, 

, i . ■ 

e)»perlance of the school dIsWict, expertise of professional educators, adoptltm 
of current fads or trends^! riact I ve measures to social pressure, response to ^ 
"sales pitches" from coBwerclal publishers or product developers, and finally, 
tradltl«i""lt«s al*«iys been done that *i«y." 

Mil la these ppiroachas sometimes wprk, there Is no assurance that the "real 
' nMds, as compared Wuh the Mappapin$" needs or symptoms, will t» discovered. 

I 
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, in « national satnple of 79 schools. It was found that elementary school prin?'. 

■ / * ' / 

el^ls would allocate diserettonary funds mainly on/ student niSeds a<^ observ^^^y 

teachers, «! mandates of the/local or state board of education, or on tte^wsls 
^ standardized tests of student achlev«nent. Rarely v«wre suggest ions ^ard 
fr^'Parents, and almost never from stMdents (Hoepfner and others 19/1). 

,^Jtest decision iwkers are confrmited with insufficient data^ which to make 
l^rtant .choices. The needs assessment process often br^n^ to light Informa- 
tion airf attltmtes of which administrators areunawfffe, especially discrepancies 
bettfeen t^P"Own-^<W4*Us~«nd--percgptIw« tN^se of teachers, students, or 
the ctMMunlty. S - 
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HA^Oft APPROACHES TO' NEEDS ASSESSMENT 



N 



NEEDS ASSESSMENT IN A SYSTEM CONTEXT 



The Msst comprehensive approach\ls that taken Uj the context ofXsyst^ 

■■ ' ''' ' ^ \ 

anatysls applied to educational planning (Kaufman 1972, Sweigert 1971 ,^astnond 

*t1*). "^is can be conc^tualized as follOMS. 

Ti^aslc systan-enviroiMifeitVelationS to be considered In^he assessing 




are il^^ In Figure 1 (Htller 1970). in the typical needs assessment sitiatlon 

'/'^^' - ' ■ ' ■ 1 

ttei^teii Is a school district with well-defined ^rai^ical and physicat 

Xb^m^fes. It operates In an environnent which is defined by Its asslgw^ 

atteiidanee area, iiwrf In the still larfter en¥ironi»nt of a Municipal or slallar 

' pellt|djr uiMt.,^ In ttim, the systen with Its Inwedfate environment Is a sub- , 

t* syst^ of t»^ state educational system, aiid- finally, of the entire country. 

\ . Insert Figure 1 



the Instructl^al systign consists of interactiwis and Interrelations among 
six eoii^aients: the learner, the teacher, the, curriculum, the relevant rtetlwds- 
means-madla, the learning environment, and the learning. The valued targets are 
futM-e-orlentwl states or expectations, ^Is, object. fves, needs, problwm^i'ind/or 
demands that generate forces for instructional change. Such tar^ts establish 
significant relations between an Instrtictlonal system and its envirowaent and 

X ' ■■ 

lay the basis for the system's purposes and ogtput requirements. ^ 

inputs to the system are resources, energy, and Information used eltMr to 
maintain the system or to be transformed into Instructional outputs. The system 
I p rocesses the inputs through Its programs and instructional processes. Outputs 

' M ■ - 16 - ]':, 
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of th. ty$t«i are goa1-orUnt«d products, services, and/or benefits tMt the 
system produces end ^fects as a result of Its performance. The most Important 
oatputf to assess are learner outcomes-- t 

F^edbeck control establishes a "closed-foop" pattern of relations In the 
syste. by transferring Information regarding the quality of outputs Iback along , 
the fe^ck loop and comparing' It with Information available to the system 
«wi/or Individuals as Inpuu. enabling the system or Its members to .Improve the 

^ ^^Th^ sy>ri« In which needs are to be assessed may be a classroom, depart- 
ment, is Ingle school, a school district, a university, a region, a state, or 
«, even larger unit. Needs assesfment Identifies "valued targets" or goals from 
.soured both within and outside of the syst«». and Identifies and a«aly«>s dls- 
crep«»ie, between the Inputs and the outputi of the system, and between the out- 
puts artd 'Sralued targets." In other words, the outputs are "wNit |s" and the 
valued rar^ts.are "what should be." The gap or discrepancy be'twwn'them Is the 

\ - ... 

>W^tic. (2) It considers events end lnformatl«t In Interaction, not In Iso- 

l.^ (3) It Is ciclVcaJ and Iterative, and W feedbac|c-from any phase of the 
pr^ss gives Information for other phases. 



^ Cheracterlstlcs of needs assessment In the systi^ approach are (1) It Is 



A UmWL MODEL* 



T^re Is no one universally accepted mocte!! of needs assessment. Many «odel| 
that m ^ described later on., however, were developed j^ng . system appro^h. 
S use system «,alysls as the basic tool of the ess.fife'rit, A knowledge of the 
syst^ approach will also help you If you wish to develop your own approach. The 
.«,'tlons on success and failure analysis In Chapter 10 suggest some guidelines 



tl *;«^ . — (i-«i-iH i« used throuflhout this report to refer to any gwerally co- 
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and steps t6 be taken. ' 

A gem^^l syst^ model that takes both present and future mseds Into account 
was develof^d by researchers at the Northwest Regional Educational laboratory fn 
fbrtUnd^ Oregon. ^thelr model contains a" planning and evaltwtlon cycle con- 
sisting of five activity clusters: (A) needs Identification, (B) problem-policy 
transformation, (C) policy-program transformation, (0> tactical program design, 
and (E) monitoring. There are detailed Intercommunication llnlks among them, 
through associated managanent Infortnatiw systems (Bell and others 1971) • Figure 
2 lltustfates Cluster A— needs Ident I ficat I on—which sums up the process for a 
th^ii^tleatly eon^lete needs assessments - . ^ . 



Iniert Figure 2 



In this model, two groups of c(Nistltu«its are used to determine "what ought 
'* to be** and 'S^t Is." toth current and future expectations are synthesized and 
decision makers screen the neeJstatements. to Identify those which can be appro- 
prtately satisfied through educational activity. Revised statements of expec- ■ 
tatlons or needs jre taken back to the originating groups foffi'alldatlon. The 
statMwnts are then transformed to measurable, observable Indices. 

Data on "what Is" are collected fr«n existing records and supplmehted as 
n^edi. Discrepancies betii^en ^^what Is^' and 'S<rhat ought to be** are analyzed and 
their magnitude and significance are determined. The output of Cluster A Is a 
-list of priority needs. --t—:=^^^=:=:^--^^ 

. ■ # 

CRITiRIA .FOR A GOOD MODEL 

Just as there Is no universally accepted model, so there Is no one generally 
used set of criteria for judging models. The following se^t, offered as a check- 
list cf questions to consider when selecting procedures or Instruments, combines 

ERIC : • , - • 



19 




t4Mt from'Ueveral sources:' the New Jersey State Department of ^cjtlon planning 
book on mtds assessment (Kaplan 197'»)j an analytical study by Southard (197*) at. 
riorWa Stite University; the State Educational Needs Assessment Project of Arl- 
ith 1970); and a list proposed by a pa^l of experts (advisers to the 

present study). ' '% 

I ' f 

\. /tenerat model characteristics 

—Does It have all ijhe coo^wnents of a complete model? 
--Has It been fleW tested and evaluated? ^ 
—Is It easily re^JIcable? , 

—Does It provide for ^»road and widespread participation of the 
educational and lay conaunlty? : , 

> the cost reasonable, and commensurate with the benefits to 

be gained? ^ 

r-Does It have a fclear management structure? 

2., Teclinlcal characteristics 

\~Are all the steps clearly explained and Illustrated? 

... \ ■ • , . • 

—Are the limitations of the method statiad? ^ 

—Are ti^ forns or Instrtanents clear?.. i 

-If no forms are provided,, are ttiere Instructions fof local ' 
development? f' - f 

^. -Are the data to be collected uq«nbituqus? I s.#-. distinct 1 09 , 
" made between process/ learner apd outcome/1 nst I tut looal needs, 
and between "needs," ••sSlutl^fls." and "resources"? 

i,— Does l,t assess learner needs In the cognitive, affective, «id- 
' psychc^tor domains? 

—Is It feasible? practical? 

-HJoes It appear to iave valldlty--l .e. , will the process actually 
. generate the data antlclpate^or needed? 

-Are methods given for synthesizing objective and subjective data? 
3. Contextual criteria 



Rir 



■-Is the model adjustable*to local conditions? 



\ 



—Is It designed to develop a reasonable list of recommendations 
for action? 

—Will the procedures be acceptable to different ethnic, cultural, 
and socioeconomic groups? Are non-English versions of the 
materials available for non-Engl Ish-speaking participants? 

—Does It have a bullt-ln mechanism for continuity and easy tran-r 
sitlon to a succeeding model for the next stage? 

—oVes It provide some mechanism for renewal of the system, anti- 
cipating and responding to social changes? 

— Is \\}ere a mechanism for evaluation 6f the process and of the 
outcomes of the needs assessment Itself? 



The development of modelP^s stllT In the beginning stages. A model which 
might rate high on some criteria might rate lower on others. In your search for 
a model, or for a set of Instruments or procedures, select the criteria that are 
most meaningful to you and apply them to models which appear to have the most 
suitable general set of characteristics. 

\ 

SOME PRACTICAL MODELS \ 

In this section are brleV^y listed some published models and Instruments 
which, because they are widely li^ed or Illustrate Important characteristics, will 
be referred to several times In th^ ensuing chapters. For convenience they are 

given In alphabetical order by the Initials or ''shorthdnd** terms by which they 

\ 

will be later identified.. 

Table 1 presents a matrix of descriptive characteristics of these. models. 
Information about publishers ^nd contact persons for these and other models Is 

given in Appendix A^ They ar«^ more fully described in Chapter 5. 

\ 

% 

Insert Table 1 



ACNAM . Alameda County Needs Assessment Model for elementary sehools. 
Battel le . Surveys for secondary schools and community colleges from\ 
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Battel le's Center for Improved Education. 

Bucks County . Instruments to assess extent of attainment of the 10 goals 
for quality education In Pennsylvania. 

CSE Kit . CSE Elementary School Evaluation Ki.t: Needs Assessment, from the 
Center for the Study of Evaluation at the University of California, Los Angeles. 

Dallas Model . A model developed by the Dallas (Texas) Independent School 
District, for all levels. 

ESA; An accountabi 1 1 ty model published by Educational Systems Associates 

of Austin, Texas. 

Fresno Model . Guidelines for a school -commun i ty conference, developed by 
the Fresno (California) County Superintendent of Schools Office. 

IGl . Institutional Goals Inventory! For colleges and universities, pub- 
lished by Educational Testing Service. 

PDK. Phi Delta Kappa distributes a model developed by the Northern Cali- 
fornia Program Development Center, Chlco. 
W Westinghouse. Survey instruments for secondary level published by.Westing- 

iiouse Learning Corporation. 

Vtorldwide . A comprehensive system approach developed by Worldwide Education 

and Research Institute. 

The above models are largely oriented toward present goals and needs. How- 
ever, some projects have developed approaches to identifrlng probable needs In 
the future and to planning for them. Project SWEP (Skyline West Educational Plan 
for Dallas-Fort, Worth); Project Redesign In Palo Alto, California; and Project 
Simu-School in Chicago, Dallas, and Santa Clara County, California, are examples. 
They will also be discussed In more detail in Chapter 5. 



SOME THEORETICAL MODELS 

The following theoretical models will also be referred to occasionally to 
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lUustrate certain themes. They will be de>crl^d>o''e fully In Chapter" 9. 

' • Ell' A general evaluation model developed' by the EPIC consultant firm In 
Tucson, Arizona. 

ESCO . A model that* relates educators (E) , students (S) , and the consumers 
of the educational product (C) to learning objectives (0) (Swelgert 1971). 

Kaufman's Model . A comprehensive model In the context of system analysis, by 
Roger Kaufman. He has also Identified three types of needs assessment strategies, 
which win be discussed In the- section on generic strategies, below (Kaufman 1972). 

Woodbury's Model . A research model ior arsesslng state educational needs 
designed to facilitate Interstate comparisons (Woodbury and others 1970). 

EVALUATION OF MODELS \ 

It Is difficult to find research or evaluation data on the practlcaHty, 
effectiveness, and utilization of most of the models. The ESCO model was one 
of the earliest to be field tested. The CSE Kit was extensively field tested 
In California and with a national sample before Its final packaglng^nd publi- 
cation (Hoepfner and others 1971). -The Bucks County model also underwent some 
field testing during development. ACNAM has undergone a field test' In some 510 ^ 
schools In California, and Is being evaluated by use.rs and administrators a.t the. 
time of writing^ As for the other models mentioned, most have been widely used 
and Information on their acceptability Is available from users and administrators. 
Case studies of some are reportec in Chapter 9 for Illustration. 

Aside f.rom field testing, however, ^there is no research which this writer v 
has found that compares the effectiveness of one- approach with ano^he^,,, f rom 
o empirical data In the fl-eld, or which Investigates the reliability or valld:ity~ ■ - 
of the findings frotnthe various approaches. Southard (197^) and Kaplan (197^) 
have compared s.ome of th^modelF on sets of a priori criteria. 



23 



GENERIC, STRATEGIES . 

Kaufman has Identified three generic strategies used In needs assessment: 
Inductive (Type I), deductive (Type D) , and classical (Type C). Figure 3 Il- 



lustrates these. 



Insert Figure 3 



, Type I Is Illustrated In such models as the Fresno, Bucks County, and Dallas 
models. In the Fresno model, a procedure reminiscent, of Flanagan's Critical 
Incident technique (Campbell and Markle 1967) Is used to' generate statements of 
(1) what Is keeping the school from doing the Job It should do, and (2) what 
the school "ought' to" be doing for the students. 

In the Bucks County study, critical Incidents were used to generate state- 
ments of specific areas related to each of the 10 goals of quality educatlxjn of 
Pennsylvania. In the Dallas model, evaluation and the Identification of needs 
precedes goal setting. Evaluation data from the previous year lead to needs- . 
assessment, which In turn leads to setting long-range goals. 

type D can be exemplified by the CSE and Worldwide models. The CSE model 
Is "packaged," In that It offers a comprehensive list of goals and specific methods 
for Identifying the performance data. The Worldwide- model Is a system-analysis 
approach that essentially follows Kaufman's Type D strategy, and offers extensive 
guidelines for Implementation of each phase, 

A'varlatlon of Type D Is to begin with ranking a set of goals, then set 
priorities on those goals by Identifying certain types of discrepancies, but with- 
out gathering performance data. In such models (PDK, Battel le), the "data" gath- 
ered are perceptions of different groups as to the Importance of each goal, and 
the extent to which, the schools are meeting the goals» 
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CHAPTER k 

COMPONENTS OF A NEEDS ASSESSMENT 

Although there Is considerable variation In contents and procedures among 
needs assessment models, there Is substantial '.agreement that at least four com- 
ponents must be present In a compl*te model: (1) consideration of goais; (2) 
procedures for determining the preserk status of those goals; (3) methods for 
Identifying, describing, and analyzing discrepancies between steps (1) and (2); 
•and ik) methods for assigning priorities to the discrepancies found In step (3). 
So-calleo discrepancy models usually Include all four components. Other models 
omit one or more components. 

1. GOALS: DETERMINING "WHAT SHOULD BE" 

DERIVATION OF GOALS 

In discrepancy models, goal statements usually appear In an early stage of 
the process. They are ranked for Importance In many models, but not In all. 

(a) In some models, such as Worldwide and Kaufman's, the first step In needs 
assessment Is to generate a list of goal statements, and to assign priorities to 
them. In such models the major effort of the needs assessment may be spent In 
the goal-settjng phase, with much involvement of representatives of all sectors 

of the community. '^'X^ 

(b) A second method Is for the model to supply a predetermined list of genera 
goals^hl'ch are broadly applicable. The number of goals varies. The Phi Delta 
Kappa model has 18 goat statements, the CSE KU has 106 goals, and the Westing- 
house survey Is based on 50 goal statements. The Bucks County uses the 10 Penn- 
sylvania goals. Battelle supplies from 85 to I?'* "conditions" for four client 

groups to respond to* 

(c) Still a third way Is to derive goals Inductively as Step 2 of the needs 

' - 21* - 
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assessment process, after some areas of contern have been Identified. In such a - 
model. Step 1 Is to Identify existing conditions, usually In regard to th,e school's 
curriculum areas, and Step 2 Is, to determihe what the goals should be. based on 
critical need. areas, as statements of "ideal conditions" or "what should be." 
The Fresno and Dallas models are examples' of this method. The number of goals 
varies with the school system* • O 

' (d) A fourth method may be considered a hybrid, or two-stage process. In 
this approach,- some Veneral learner anci Institutional goals are stated, and infor- 
matlpR Is collected to ascertain the (present status of each goal. The original 
goals are then restated in somewhat n,cJr« specific form as program goals or desired 
conditions. The goals themselves are not ranked; rather, the discrepancy areas 
within goals are Inspected for highjfest need. This method is now being field tested 
In the ACNAM project in Cal ifornia elementarr-^chools (Wltlcin 197'»). 

TYPES OF GOAL STATEMENTS 

A crucial issue is the t^ of goal statements used, since this often deter- 
mines or controls the kind of d^ta collected. The "Our Schools" project of New 
Jersey recommended the adoption of two sets of statewide educational goals. The 
first set. termed "outcome" goals, pertains to Individual or student behaviors 
desired is a result of the educational experiences provided. The second sfet. 
termed "process" goals, relates to criteria which the public schools of the state, 
as a Jle. should observe !n their efforts to achieve the aforesaid "outcome" 
goals. Process goals are thus related to Institutional goals. 

Many citizens do not themselves mak6 a distinction between the tv/o types of 
goals- From the standpoint of the administrative planner, however, It makes sense 
to'separate them, because the planning can be mo^re systematic and reliable when 
one Is riot confusing outcomes with processes or Input's. 
Examples of outcome goals ; 
^ "The public schools should help every persoh In the state: 
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•'To acquire basic skills In obtaining Information, solving problems, 
thinking' critical Uy, and communicating effectively, 

"To become an effective and responsible contributor to the decision- 
making processes of the political and other Institutions of the 
community, state, country, and world.*' 

Examples of process goals ; 

**The public schools should: 

*Mnsure that all Instruction bears a meaningful relationship to the 
present or future needs and/or Interests of students • 

"Insure that each student has significant opportunities, consistent 
with his/her age, for helping to determine the nature of his/her 
educational experiences," 

(A Summary of the "Our Schools" Project 1972, 37-8) 

I 

RANKING GOALS FOR IMPORTANCE 

Once the goals are chosen, either locally or from prepackaged models, the 
task Is to assign ratings of Importance to the goals. The most widely used 
methods are LIkert-type rating scales (e.g., BatteMe, IGI, Westlnghouse) or^ 
card sorts (CSE, P&K) . Westlnghouse also adds another type of ratlng—a three- 
point scale of extent of responsibility of the school for Implementing the 
goal. \ 

2. DETEI^MINING PRESENT STATUS: "WHAT IS" 
MAJOB DATA SOURCES 

The tvyo most frequently used sources of data on the present status of the 
goals are the opinions of different groups— typical ly educators, students, and 
parents— and achievement test scores. Other system Indicators, such as demo- 
graphic data, transiency rates, and others mentioned below, are less frequently 
sought. 

Perceptual data . Many widely used models and surveys (e.g., PDK, Westlng- 
house, Battel le), rely mainly on perceptions of respondents who rate the extent 
- to which goals are being met, usually on a five-point scale of perceived attain- 
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ment. Employers of the school's graduates, other Interested citizens, and college 
admissions offices might also rate current attainment of goals. Opinions of the 
public on how well the schools are doing may also be Invited without reference to 
specific goals (Fresno). ' ^ 

Student performance . Typical data are scores on standardized achievement 
tests, criterion-referenced tests, and grades In school subjects. Other$ are 
teacher observations, exan^les of student "products" or performance (samples of 
.written work), artistic and dramatic productions, science projects, or athletic 
capability, to name a few. 
' It Is crucial to Identify appropriate tests and other measures. The CSE 

and Bucks. County models give guidelines for selection of tests appropriate to 
each of the goals In their list. ACNAM supplies some guidelines and a statistical 
sunmary and data forms package for recording test scores and other objective data. 

Student performance data that already exist in school flies should be exam- 
ined before launching a new testing program for needs assessment. But care must 
be taken to see that the data really relate to the relevant goal or need aKeas, 
and that measures used are valid, comprehensive, and appropriate. 

institutional data . Relevant data which are alripW available In school- 
site and district recorlds are: demographic data (racial and ethnic distributions, 
language backgrounds, socioeconomic data, nun^ers of exceptional Students), tran- 
siency rates, and pupl) health data. 

Still other sources are records on library use, types and extent of counsel- 
ing and other supportive services offered, absenteeism, and trends In budget 
allocations. 

Further sources of Information relate to school climate and environment: 
incidence of vandalism and truancy, complaints of parents, failures to pass school 
bonds and levies, or concerns expressed to the school board or administration by 
eofflinunity action or advisory groups. 

o ZZ 
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Community records . Other sources of Information for current; and future plan- 
ning are census data, Information from local planning commissions, manpower utill- 

ft** 

* zatlon or projections from the Bureau of Labor Statistics, land use surveys, and 
data from county or nwnlclpal offices, courts, and social service agencies. 

Societal concerns . Some needs assessment approaches start from a data base 
of present or future soc I eta r concerns (e.g., Fresno). When these have been de- 
lineated, the "needs" are deterr.i!ned by analyzing the extent to which the school 
system Is addressing Itself to these concerns. An analysis Is then made not only 
of student performance but also of content of currlcular and co-currlcular offer- 
ings, and relevance of the school's goals to those of society (Worldwide model). 

GOAL TYPES AW DATA COLLECTION 

We have referred earlier to learner and Institutional goals. Although the 
ultimate focus of the assessment Is on the goals of learners, a thorough analysis 
of the needs (discrepancies) would .Include an* assessment of Institutional goals 
^ as wel 1 . 

The important thing to rc.T«mber in. both goal setting and assessing present 
status Is not to confuss the two types of goals or the data appropriate for each 
type. 

To determine present status of learner goals, usually expressed as outcomes, 
the most valid sources are probably ,the data on student performance, as well as 
students' own assessment of their attainment. Social and behavioral indicators 
relating to the affective and psychomotor domains are also appropriate. Least 
valid are global ratings by parents or citizens of student attainment on broad, 
general goals, especially when Httle or no supporting information is given to 
the raters. 

In the case of institutional of process go^ls , however, the perceptions of 
students, taachers, parents, and^Itlzens regarding the attainment of the goals 
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are highly ii|Jrproprlate. In addition, Information may be gathered on resources 
available and In use, staffing patterns, methods of Instruction, types of In- 
structional and support activities available, and pmmunlcatlon practices and 
networks. 

IMPROVING THE VALIDITY OF TEE DATA 

The determination of present status can be made more valid by usln| multl- 
pie data sources, not just perceptions or test; scores, by ca/eful sampling of 
the groups participating In the assessment, and by providing background Information 
to accompany survey questions or rating scales. 

Sampling . Most models advocate some method of stratified random sampling 
for participants In surveys or opinion polls, and some give guidelines for selec- 
ting samples; Sampling Is discussed In models by EPIC, Battel le, WeS'tlnghouse, 
Worldwide, CSE, PDK, and ACNAM. Some community Involvement models, such as 
Fresno's, give guidelines for selection of participants that are not based on 
representative or stratified sampling. 

In a large study done by Battel le's Center, the sampling plan was: (1) draw 
a random sample from parents of elementary school children to con^rlse a parent 
sample; (2) then use these parents to obtain a community sample by having 
parent suggest a neighbor of the same sex who does not Kave children In school. 

For the community college survey Battelle developed a sampling plan, similar 
to the techniques used by the TV rating pollsters and such piJbllc opinion groups 
as the Harris Poll, which would allow a sample of a very small number of randomly 
selected respondents « 

Host surveys given by educational consulting firms use valid sarytpUng 
techniques. .School districts, however, often Ignore these considerations when con- 
ducting their own surveys. Selection of participants In community conferences 
should be done on a careful and representative sampling basis. 

, ^^-^ 
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PPNA guidelines to sampling. Possibly the most complete yet nontechnical ' 
guide for use by school -site, administrators Is the supplement on sampling which 
Is Included with the Pupl T-PercetVed Needs Assessment package (see Chapter 5). 
Tables and ojtplanatlons relate sample size to population size, the effects of 
secondary variables are considered, and detailed steps and overlays take the 
user through all the necessary stages for drawing the .sample. The booklet has 
exercises, and Is thus self-Instructional. 

Background Information for respondents. Survey Instruments asking for cit- 
izens' perceptions of how well the schools are doing In relation to goals can be 
made more valid by giving some factual InfoTmatlon to the respondents. This was 
done In the Palo Alto (California) component of Project Redesign, In the 1975-76 
' Budget Priority Setting Questionnaire. 

The Questionnaire lists 25 categories affecting bu(dgetlng, such as class 

size, base allotment, length of day, elementary preparation time, transportation, 

etc. Each category has a factual description. Examples are: 

Category Elementary Preparation Team . We have two team? of 
teachers who visit grades 4 to 6 each week to provide special I zed 
Instruction In nwsic, art, ahd physical education. While the team 
is teaching, the regular teacher spends the time developing in- 
dividualized plans for the classroom. 

Category 8. Counseling . Councilors work with Junior and senior 
high students and parents In career, educational, and personal 
counsel Irig. The counselor load Is 360 students/counselor. An 
additional six special counselors deal with problems arising out 
of drug usage, truancy, or other difficulties. 

After the respondents have studied the categories affecting budgeting, they 

are asked to make Judgments. There Is an easy-to-follow system of allocating 

points for Imaginary reductions for each of the 25 categories, and asking for 

the respondents' Judgments about where In the budget cuts should be made for X 

number of points, which categories to protect , and which to expand. 

Following that, alternative plans are assessed, based on Information regarding 

the effect of cuts on the schools anAg)proxlmate decreases In the tax bill of a 
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$40,000 house. Only then does the respondent rate each curricular area on degree 
of emphasis to be given, for elementary and secondary grades separately . In the 
final step, the respondent can add categories. 

When aisking opinions about how well the schools are teaching reading, Infor- 
mation along the lines of , the following might be given: 

In grade k In School M , seven hours a week are spent on 

reading Instruction, The average scores op reading comprehen- 
sion for 4th grade pupils are at the 55th percentile on a 
nationally standardized test, and are within the expected 
range of scores for the school district, based upon social, 
economic, and other factors. Should the school spend more 
time on reading Instruction, less time , or Is the time about 
right? 

Another example: 

Here is a profile of what Is being done to Individualize In- 
struction In the primary grades In your child's school. Does 
your experience confirm or contradict this? 

Research shows that the usual sources of Information to parents on what the 
schools are doing and how well they are doing It are their children, neighbors, 
and the news media. Very little Information comes from school boards or school 
staff. Parents often have limited bases for judgment. If the major data base 
Irt the needs assessment Is to be subjective judgments of citizens on the degree 
to which the school Is presently attaining Its goals, the validity of the judg- 
ments will be enhanced by preceding the goal statements with factual Information. 

3. IDENTIFYING DISCREPANCIES 

The third component Is the Identification and validation of discrepancies 
between the goals and the present condl t Ions— between **what is*' and **what should 
be,*' These statements of discrepancies are the needs, and the outcome of this 
component Is a series of statements about needs, v \^ 

Discrepancy analysis Is said !:o have at least three characteristics: 

The data must represent the actual world of learners and rented . ' 
peopll, both as It exists now and as It will, could, and should 



32 



exist 'in the future.* 

No needs determination Is final and complete; we must realize that 
any statement of needs Is In fact tentative, an^^e should con- 
stantly question the validity of our needs statement. 

The discrepancies should be Identified In terms of products or 
actual behaviors (ends), not In terms of processes (or means). 

(Kaufman 1972, 29) ^ 

Identifying areas of discrepancy Is one thing; quantifying them to make 
judgments or to asslgtj priorities Is another. Methods range from simple equa- 
tions (e.g., desired performance mjnus present performance eqUals discrepancy) 
to sophisticated and complex procedures using weightings aad adjusted scales. 
Some of the variations are described In Chapter 6. 

An Important but frequently overlooked aspect of the discrepancy analysis 
Is the Investigation of the causes of discrepancies— the reasons for the gaps be- 
tween where learhers are, and where they should be. In relation to goals. In 
practice, all too often, both professionals and the public tend to make- rash ^ 
judgments about the discrepancies artd their causal or related factors), wltl^Qut 
Investigating further. This Is particularly true where priorities are set :mply 
by choosing those goals that ratci highest In Importance and lowest In perceived 
attainment. 

The causes of the discrepancies will lie either (1) within the learners, 
or (2) within the Institution. Information on learner characteristics, experi- 
ences, and background will be useful for (1), and Institutional or process needs 
win give data on (2). In fact, the needs assessment might be done In two stages 

the first, to assess Instructional or outcome needs of the students, and the 

/ 

second, to assess the Inputs of staff, program, facilities, and other resources. 



*Ho8t of the differences and diversity Ir needs assessment models and aPP^aches 
stem from this statement and from Interpretations given to S"ch key words/phrases 
.8 "actual"; "as It exists now"; "as It will, could, or should." Who should make 
these Judgments? On what basis? How satisfactory are they for those affected by 
them? 
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This method Is Illustrated In the User's Manual of the ACNAM (WItkIn 197^, . 
Chapt,er k) , The Worldwide manuals also show how to analyze the needs in depth 
through the concerns analysis, which Integrates facts, values, and policies. 

A technique which has been developed specifically to analyze "causal" chains 
In Fault Tree Analysis (see Chapters 6 and 10). After Identifying a high pri- 
ority need area, a Fault Tree Analysis can be performed to indicate the most 
probable reasons why the need has occurred. The analysis has built-in methods 
also for indicating the areas in. which solutions are likely to make the "most iin- 
pact. I 

*' i». ASSIGNING PRIORITIES TO DISCREPANCY AREAS 

The final major component is the assignment of priorities to the discrepan- 
cies or needs. This component should generate information which is directly 

applicable to program planning. 

in this stage you set criteria to determine when a need is critical, and 
agree on guidelines for arriving at a consensus on priorities. 

As with the identification and quantification of discrepancies, models ex- 
hibit a wide range of methods for assigning priorities and ratings of critical ity. 
The simplest compute mean ratings of importance (of goals or need statements), 
and then rank the goals from the highest to the lowest mean rating. The most com- 
plex use decision rules, taking Info account the magnitude of a discrepancy, the 
probability that the need can be met, utility, cost/benefit ratios, and similar 
factors. 

CSE DECISION MODEL 

The CSE Kit offer? a decision model and decision rule for setting priorities. 
The model differs from most other methods suggested to determine critical ity of 
need, In that It takes several components into consideration, and does npt rely 
on a simple mathematical discrepancy between ratings of importance and attainment. 

ERIC 
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The decision rule Is: 

Plan to revise the Instructional program In the goal areaCs) 
that has (have) the highest priority value(s). The priority . 
value is based upon: 

1. The rated Importance of a goal area 

2. The utility of Improving student performance 

3. The probabJllty of Improvlnrig student performance. 

(Hoepfner and others 1972, 76) 
The curr-snt level of student performance Is derived from standardized tests 
dVfectly related to the goals. This level, expressed as, a differentiated school 
percentile. Is used to arrive at a figure for probable Increase In utility, In 
each of the main goal areas. The forimila used Is: 

Priority value - Rated Importance x Probable Increase In utility 
Although this method Is more complex than that of most other models. It Is 
probably more exact. The guidebook In the CSE Kit gives explicit directions for 
Its use. 

^GRAPHIC COMPARISON METHODS^ 

^ \ Two studies Illustrate how you might assign priorities by relating goal Im- 

. ■■ ' ' 

pdrtance to goal attainment In graphic form. 

An assessment of educational television needs In Maryland used a mathematical 
mo<i^l (Hershkowltz 1973). First, mean scores of Importance -and mean scores or 
attjilnment established a Cardinal Rank and Critical Ity Index. A goal area be- 
caJL a critical educational need If It met two criteria: (1) Its mean score of 
Importance must be greater than the overall average Importance score, arid (2) 
Its mean perceived extent of attainment must be less than or equal to the overall 
average attainment score. 

Analyses were made separately for each cHent group. Priorities were given 
to those goals to which four or more groups assigned a'crltlcal need. Figure 
shows the critical Ity function of four goals for the. school staff respondent 
group. C9 
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Insert Figure k 

A statewide public opinion survey In .New Jersey produced ratings of 16 out- 
come goals on scales of Importance and excellence. Figure 5 shows how the two 
ratings were compared. In this method, the goals are plotted on two axes as in 
the Maryland study, but are not related to group mean scores. The vertical axis 
shows the percentage Who rated each goal "very Important" and the horizontal axis 
shows the percentage rating each goal's attainment ''good'^ or '*excenent." 

'I 

Insert Figure 5 

Those goals falling in Quadrant I have top priority for program efforts. 
Those In Quadrant II would be recommended for continuing the present good efforts, 
(Opinion Research Corporation 1972). 

In the f inal/analysis, however, evidence of the priorities given to the need! 
and the significance attached to them are usually evident in how school bur jets 
are revised to provide resources for meeting the most.critical needs. The out- 
come of the discrepancy analysis is presumably a plan for action, with Objectives 
specified and resources committed to their attainment. 

VALIDITY AND COMPLETENESS 

CCMPOSITE MED STATEMENTS 

In the Introduction to this study It was pointed out that a need Is not the 
same a$ a wish, or a solution, or a goaK If the needs assessment process takes 
account of all the major components discussed here, the needs will be clear state 
ments of discrepancies. Otherwise, they will not be valid. 

Examples of statements which are not_ correctly stated as needs are: 
•*There ought to be better ccwrwnunlcatfon between counselors and parents.*' 
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"ChlUren should have more Indlvlduallzied Instruction In science.'' ^ - 

"Reading scores In grades 2 and 3 In this school are too low." . 

"There Is Inadequate cooperation between the home and the high 
school •" . V 

Here Is an example of a composite need statement which reflects the results 
of^\3ill components in'the assessment, A goal of reading comprehension has alr 
ready been determined to have high priority: 

When reading, pupils will be able to comprehend and recall the 
content of written materials, ranging from simple recall to fn- 
ferentfal comprehension. 

The need analysis Is for grade 5: * - 

Existing condition ("what Is") : On the- reading subtest of t'he ' 
CTBS, 70% of project pupils fell below^the 50th percentile on 
' the norm- reference group, and 50* below the 20th percenilVe.^ ^ ; 
Teachers report that the majority of their pupils have dlTflr 
culty decoding and /fading without assistance, and unrferstand- 
Mng content read. Only 35* of pupils report "I understand 
'•what I read" 'and 60f of their parents report that the students 
understa.id whpt they read "only a little" or "not at all." 
(Source: test -scores and teacher, pupil , and parent surveys*)^ 



Desired condition P'what should be") : Fifth grade pupHs should 
be able to read and comprehend written materials approprlate-for 
their ageand experlencev from simple recall to Inferential com- y 
prehension. This Implies that scores on a standardized test wIlK 
approach a normal distribution for the pupil population, and that 
reports from teachers, pupils, and parents wHl confirm this. 

Discrepancy ; Compared with the normative ^grouo of the 'CTBS, 20* 
too man/ pupl Is ai^-bejow Q, and 30* too >teny a>e below on 
reading comprehension^ This discrepancy Is confirmed by parent, 
teacher; and pupil 'survey^. ' ^ — • ^ ^ 

Analysis of discrepancy ; No diagnosis Is made to determine 
learner's strengths and weaknesses. Materials are Inappropriate 
to performance level of pupils. Staff lacks understanding of 
how to meet individual differences In reading. 

Program -objective ; By May 1976, scores In reading comprehension 
of 5th grade pupils pn the CTBS will reflect a distribution such 
that 60* or fewer will fall below the standardized .d, of the norm- 
reference group, and 35* or fewer will fall below Qi. Also, 80* 
of the teachers will report that at least 50* of their pupils can 
decode and read without assistance, and 60* of parents surveyed 
will report that their children understand what they read "a fair 

amount" or "a great deah" . , r/v 

(ACNAM User's Manual 197^, 56) 
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The discrepancy analysis thus defines the need and sets^torth priorities 
for program changes 'and staff development. 



THE GIGO PRINCIPAL^. 

There Is a classic saying from system analysis and computer technology— 
"garbage In, garbage out." The outputs from the needs assessment will be no 
better than the' Input? If the- process Is carried on In such a way that the re- 
spondents are not really representative of the educational partners, or' do not 
urtderstand what they are doing, he questions asked of them cannot really be 
"answered," or the data collected are Invalid, or th'e data analysis Is Inaccurate 
or based on faulty assumptions, the Information gathered and, the decisions made 
will be worse than useless. 
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CHAPTER 5 , 

COMPREHENSIVE KITS, INSTRUMENTS, AND MODELS FOR LOCAL ASSESSMENT 

This chapter offers descriptions of selected needs assessment approaches 
suitable for the school or district level. Although they differ in many details, 
they are similar in that they are Intended to perform a broad-based assessment, ^ 
rather than one in^ single curricular area. They are presented in alphabetical 
order. 

The models included here were chosen because they offer specific guidelines 
and published materials or manuals for the practitioner rather than general ' 
theory. Most of. them have been widely used. Appendix A lists publishers and 
prices of materials. Chapter 9 gives case histories illustrating applications 
of some, of the models. 

• A' section at the end of this chapter is devoted to a. brief descW^tJ on of 
some projects which have put needs assessment' in the context of futurfe planning. 

PRACTICAL MODELS AND SURVEYS 
AC NAM 

The Alameda County Needs Assessment Model was field tested during January- 
June 1975 in some 510 elementary schools in California, with approximately 88,000 
pupils, teachers, parents, and school staff articipating. Evaluation of the 
procedures and instruments will be published in late 1975. 

The model consists' of six preprinted surveys, two paci<ages of statistical ^ 
summary and data forms, ^nd a user's manual. The surveys are designed for 
teachers, parents, elementary school pupils, and administrative and support staff. 
Responses are put on optical scan sheets; data processing services are available. 
The parent survey Is published In English and Spanish, and the pupil survey has 
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a readers' and nonreaders' (picture) version. 

The context for the model Is a general system approach. The surveys gather 
specific factual Information on pupils' knowledge, skills, and attitudes In 
reading, language development, mathematics, and multicultural education. Ques- 
tions for parents and sc' ool staff relate to Input and process variables supporting 
the Instructional areas, as well as needs for a bilingual education program; health 
and counseling services, and staff and parental In-servlce. 

Survey questions are based on three outcome goals for each Instructional and 
support area. Goals and questions may be modified locally. The survey data are 
synthesized with standardized test scores and statistical and demographic data to 
arrive at (1) program goals, (2) discrepancy statements, (3) analysis of causes 
of discrepancies, objectives, (5) activities, and (6) time lines In Instruc- 
tional and support components. ' - 

ACNAM was developed to assist elementary schools In California to assess needs 
as the basis for applications to the state educational agency for consolidated 
funding. The Instruments, however, are appl Icable elsewhere, particularly the 
teacher and pupil survey forms. Although ACNAM Is a discrepancy model, It does- | 
not r.ank goals for Importance, since the requirements of fufiding sources have al- 
ready set priorities for general currlcular areas. Discrepancy analysis Is based 
on multiple data sources for "what Is," not on people's perceptions of goal Im- 
portance and attainment. , 

Battel le ^ 

Battel le's Center for Improved Education has developed a set of needs assess- 
ment surveys for local school districts, suitable for secondary level. 
• Four preprinted questionnaires, designed separately for parents, students, 
staff, and the community at large, contain varying numbers of statements of 

t 

conditions about schools drawn from a master list of 174 Items. The Items, In- 

11 



eluding both learner and Institutional variables, are based on 16 functional areas 
of a model school system, and a philosophy of participative management. The areas 



are: 



Personal development of the student, educational program. Individ- 
ualizing Instruction, Instructional management, guidance and ^oun- 
' sellng, managing auxiliary programs, formulating pol cy, Pla^;;"9' 
Innovating, communicating, supervising, PI^^l*""' ' ''f^s 

development and board orientation, managing facilities, resources, 
budgeting, and evaluatiofi. " 
Participants In the^^ssessment are chosen on a stratified random-sample 
basis. Respondents rate each .statement of conditions on two five-point scales- 
one for their perception of the W"^. ^° condition actually exists, or 
of the "actual state" (A); and one for^elr perception of the extent to which 
the condition should exist, the "desired state" (D) . A need Index for each goal 
statement Is the numerical difference between the two scale values, A and D. The 
need Indices are then arranged in order of magnitude to show the rankings of the 
goa 1 s f ^ 

Battelle's instruments were derived from surveys of needs assessment materials 
and the literature on educational theory. The questionnaire Items were revised 
after review by lesearchers, educational consultants, faculty, students, and com-. 

munlty groups. ' • 

Battelle will furnish computer printouts which display distribution of scores 
and need ihdex for each goal by groups, the percentage of responses for each goal 
by groups.' and the percentage of responses for each point oyhe scale for A and 
D values, as well as mean responses. ' 

Bucks County 

Bucks County Public Schools (Pennsylvania) has produced Instruments for the 
statewide Quality Education Program Study of Pennsylvania that could be used in 

any elementary school. i ^ 

The model consists of a set' of small booklets; a flenejiai needs assessment 
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Instrument, based upon the 10 goals for quality education In Pennsylvania, and 
10 specific instruments, one for each of the g^ls. The goals, which have been 
widely adopted or adapted outs'de of Pennsylv^ia, are self-understanding, under- 
standing others, basic sk\Us, interest in school and -learning, good citizenship, 
good health habits, creativity, vocational development, understanding humah accom- 
plishments, and preparation for a world of change. 

The general instrument (Booklet B) can be used by parents, students, teachers, 
or administrators. It contains the 10 goals and several sub-goals or indicators 
for each, all of which are rated on a •five-point scale of importance. Ratings 
can be done on a paper-and-penci 1 scale, or by a card sort. The total points c^f • 
all ratings are used to determine priority areas. 

The Individual instruments, one for each goal area, arc self-assessments to 
be done by pupils, who rate themselves on a number of specific behavioral Items 
on a five-point scale of frequency (how often the pupil does the action or exhibits 
the trait).' 

An example of the way the general and Individual instruments are related: 
Goal 2 is "understanding others." Area 1, rated by different groups for i mportance 
in the general Instrument Is, 'Svorks with or helps people different from self." 
Two specific'^bSS^IoTs foTArea i, rated by pupils for frequency are, "has a 
friend who Is different In some way from himself," and "stands up for another 
even though he Is of another race." Many other statements of this level of con- 
creteness are Included for ea?h area of each goal. 

There Is a separate booklet for each goal area, and each includes an analysis 
of published tests suitable for that goal area, with the title, form, publisher, 
date, grade level, brief description, and bibliographic notation. The tests were 
chosen after a research study determined their appropriateness, but are not 
evaluated for quality. 
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Distinctive features of the Bucks County model are: (1) Its statements of 
goal areas and behaviors were derived from an empirical study using the Critical 
Incident technique, (2) the 10 goal areas are clearly maln^talned as a structure 
for the general and specific Instruments,, (3) pupils do a self-assessment, and 
(if) appropriate tests are listed for each goal. The specificity of the state- 
ments to be rated no doubt Increases the validity of the judgments. 

Thp ma^Ilgemcnt structure Is left up to the local district. It Is not clear 
■Srlhe ratings from the general Instrument are to be related to the, ratings from 
the Individual Instruments, or If they are to be related at all. 

CSE Kit 

The CSE/Elemcntary School Evaluation Kit: Needs Assessment consists of a 
guidebook and a box of materials containing principal's goal rating forms, 10 
decks of 106 goal cards. 10 sets of rating mats, 50 rating forms,^and 48 parents- 
goal rating questionnaires. Replacements can be ordered. 

Research Information on the model, which was field tested In a national 
sample of 79 schools and a California sample of 100 schools. Is available in a 
report (Hoepfner and others 1971). The model was developed within the framework 
of evaluation. 

• The school principal directs the process, which Is In four steps: 

1. Gather Information* on goals the school should be meeting. 

2. Select tests to measure student performance on highly rated goals. 

• 3. Interpret the school's test scores In relation to those of other 
schools with similar characteristics. 

. Use a decision model to transform the Information already 
gathered Into a set of critical need areas for the school. 

For Step 1 there are statements and descriptions of 106 goals In 41 areas. 
Goals are rated for Importance on a five-poFnt scale by questionnaires or card sorts. 

For Step 2, a comprehensive list of tests is furnished, specifically related 
to each goal area and sub-goal, with a rating of each test according to four crl- 
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terla (the MEAN test evaluation): Measurement validity, Examinee appropriateness, 
Administrative usability, and Normed technical excellence. The ratings are based 
on extensive analyses of published tests for elementary and secondary schools 
undertaken by the Center for the Study of Evaluatlon'at the Untverslty of Call- 
fornidi Los Angeles. > 

For Step 3, there Is a table of differentiated school norms and stx correc- 
tion factors. Values based on these factors are coded and then added or sub- 
tracted to the national norms of standardized tests to derive corrected norms for 
the school, for grades 1, 3, 5, and 6, The correction factors are family occu- 
pation, racial composition, geographical location, transiency, numbers of non- 
Engl Ish-speaking students, and role 6f teachers In Inl tiatlng. new educational 
programs. Examples are given of the step-by-step proc^ for coding .and finding 
the school norms. 

For Step 4, a decision model and decision rule are offered to set priorities. 

x ■ 

This was described In Chapter 
Dallas 

The Dallas (Texas) model Is used as part of the annual budgeting process. 
The first step Is not the ranking of goals, but the determination of high priority 
-need areas. Within the budget cycle, evaluation and needs assessment precede 
goal determination, A survey Instrument listing areas, of Instruction, classroom 
operation and management, services for students, school management/ and develop- , 
mcnt services Is used to obtain Individual Judgments of present and desired con- 
ditions. The survey uses 15-polnt rating scales. Outputs show the rankings or 
priorities desired by principals, teachers, parents, and students; the areas of 
greatest difference between perceived present and desired conditions; and com- 
posite rankings of priorities and greatest difference areas. 

The Dallas model Involves the Board of Education, program managers appointed 



for each of the district's seven long-range priority goals, and a 600-member 
committee which Includes teachers, students, parents, other citizens, prin- 
cipals, central office staff, and representatives of all district employee 

groups. ^ / 

Program managers evaluate |he accomplishments of ongoing programs In the 
light of the previous year's goals or of long-range goals, and report to all 
Individuals involved.,, Smaller Z^f-member committees meet monthly to focus on 
various areas of the school program, oinformatlon from the needs assessment 
Purvey Is used together with all other data In arriving at priorities for plan- 
ning. 

Represent^ I yes of all the small groups meet with the Board at Its first 
weekend ritreat on the budget to respond to and revise compiled needs. Based 
upon the Identified needs and the gaps which represent greatest discrepancies 
between actual and desired status of programs, the program managers select goals 
to be worked on during the year. 

Educational System Associates > 

This organization has Issued a manual which gives guidelines, procedures, 
and a case study on conducting a needs assessment. Based on accountability, the 
design uses three types of measurement: a survey of perceived needs, an analysis 
of secondary sources, and the direct measurement of existing status. Both 
learner- and process-oriented goals and objectives are included. 

' The goal -ranking instrument provides for discrepancy ratings, on the 10 goals 
of the Arizona needs assessment program. A public opinion survey Instrument used 
In the Merrill (Wisconsin) Public Schools In included. A sample case study Illus- 
trates the application of the method to an ESEA. Title I program, gives Infor- 
mation on sampling a^d data collection, and reports the results of the four 
phases of the study. A distinctive feature Is a list of examples pointing out 
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limitations of -the study. 
Fresno 

The Fresno (California) model has been widely Implemented In California 
schools. Like the ACNAM and Dallas models, It does not begin with the gener- 
ation or ranking of goals. The heart of the Fresno model Is a conference which , 
considers two questions: "What are the things which are keeping our schpol from 
doing the job It should do for the students?" and "What are the things our school 
should be doing for the students of this community?" 

"Figure 6 shows the relationship of needs assessment In the Fresno model to 
educational planning and the cyclical nature of the process. 



^grt Figure 6 



..Ihe-statements of concerns and "shoulds" are generated at a one-day community 
conference, usually with about 100 people. Parents, teachers, and students parti- 
cipate through interactive small groups, each table of five or six generating Its 
statements'and passing them to other tables for priority rankings. The procedure 
is repeated fouYor five times. Statements are ^ater sorted Into categories; and 
those which achieve overall high nun^cal ratings are used as the bast/ for 
stating program goals. From this point a steering committee proceed^wlth a gen-, 
eral system analysis approach,, breaking the goals Into objectives arjd planning " 
programs to meet them. Figure 7 Illustrates the steps In the modelj A f|lm- 
strlp, audio-cassette, and manual Illustrate the entire procedure iH simple steps 

» 

(Jordan 1973). 



Insert Figure 7 - . \ 
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, This model, relying mainly on the community conference and follow-up meet- 
ings by parcnt-teacher-student committees, provides no predetermined sets of 
goals nor packaged Instruments. It does not analyze discrepancies In a mathe 
matlcal sense nor validate community perceptions through *'hard data.'* In prac- 
tice, however, steering committees tend to refer Informally to standardized test 
Information already available to confirm or dispute statements made at the com- 
munlty conference. 

Phi Delta Kappa (PDK) 

This model, developed at the Northern California Program Development Center, 
Chico, Is distributed nationally through 23 training and dissemination ceriters of 
Phi Delta Kappa. 

POI^ has three phases: (1) rating goals for Importance and degree of attain- 
ment, (2) setting objectives based on the high priority rankings, and (3) develop- 
ing performance objectives and plans for In^lemcntatlon. Manuals and goal-sorting 
materials are contained In workshop packets for Phase 1. Most of the districts 
now using the model appear to be In Phase 1, or are gearing up for Phase 2, for 
which a manual on writing objectives Is available. An estimated 10,000 people 
have been trained to use Phase 1 of the model at the training centers. 

Figure 8 Is a flowchart of the PDK model. 



^ Insert Figure 8 
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The goal Vating process uses a type of card sort, with active Involvement of 
educators and citizens Individually and In small groups. Eighteen goal statements 
with descriptions are provided on Individual cards and rating sheets. Colored 
discs and a game board-Are-used with the cards In a semi -forced-choice procedure, 
which results In group ratings, tach goal is assigned ratings of Importance on a 

' CI ^. 



/ 



ERIC 



^♦7 



flv^-polnt scale, and the data ar^ displayed to show the judgments of different 
client groups. Instructions are given for assigning critical Ity ratings. 

Goajs are also ranked Independently, using the card-sort process, by a 
representative commun Ijtk' committee. Consensus rankings are arrived at In small 
group sessions. Committee members then rate how well the current school programs 
are meeting each goal, on a 15-polnt scale. Average (mean) scores for each goal 
are derived, and criteria are furnished for Interpreting the data. 

Schools have the option of adding other goals, but in practice they rarely 
do. In this model the emphasis Is on assigning priorities to goals, and on In- 
volving the professional and public community. The "needs" are the high priority 
goals. There Is no provision for Integrating test or other objective data with 
those goals to arrive at a discrepancy between "what Is" and "what should be," 
or to validate the perceptions of the raters as to how well the current educa- 
tional programs are meeting the goals. The discrepancy data are based solely on 
the judgments of those involved In the assessment. 

Pupil -Perceived Needs Assessment (PPNA) 

Research for Better Schpols, Inc., a regional educational laboratory in 

\ 

Phlladelphla.'^has Issued a kit which gives educators explicit Instructions on 
how to develop need Indicators and' to conduct an assessment of needs as perceived 
by pupils. The methodology Is suitable for any grade level. 

The kit consists of a box containing a tape cassette and six booklets- 
planning a PPNA project, developing a PPNA Indicator, administering the Indicator, 
processing indicator data, analyzing and reporting results, and a supplement on 
sampling. The booklets are well organized, easy to read, and explfcit. 

The PPNA is unique among needs assessment kits in that It gives step-by- 
step Instructions for local educators to develop their own indicators of pupil 
needs. Simple checklists and criteria help the administrator or teacher decide 
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on the type and length of Indicator and method of development; formulas and steps 
are provided for estimating personnel time and costs. 

Westlnghouse 

A preprinted survey questionnaire for secondary schools Is available from 
Westlnghouse Learning Corporation. It consists of 50 general goal statements, 
with descriptors, which are rated separately on three different scales: (1) a < 
five-point scale of Importance, (2) a three-point scale of adequacy of attainment, 
and (3) a five-point scale of judgment of the school's responsti)! 1 1 ty for the 
goal. All statements are worded In terms of student skills, knowledge, or at- 
titudes. Three general opinion questions are Included on Institutional and en- 
vironmental factors affecting the school's performance. 

The one Instrument can be used by various client groups, such as community 
and educators, with separate analyses made of their responses. Districts may 
also use the three-way model to develop a custom-made instrument. 

The model, now In Its third edition after field review, was developed in 
cooperation with the Measurement Research Center at the University of low^.' 

The following formula Is used to arrive at priorities: 

Priority raniclng of needs - Importance x Responsibility J 

Attainment 

'J 

Reports provided are: summary rankings of goals according to nleds, with 
comparisons among client groups; profiles of ranking of goals; and separate rank- 
ings according to importance, needs, and school responsibi Ity for each respon- 
dent group. ^ 

The Battel le and" Westlnghouse surveys, although on the(' surface somewhat sim- 
liar, differ in the derivation and focus of the goal or condition statements, the 
types of judgments to be made, and the calculation of need indices and bases for 
assigning rank or priorities. They are alike In that they determine the discrep- 
ancy between "what is" and "what should be" entirely through the opinions of the 
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respondents , 



Worldwide . 

^ The Worldwide model, developed as Project Next Step (Eastmond IS?'*), has 
been widely used at both local and state levels. Materials available are a needs 
assessment source book, 10 manuals keyed to a master flowchart, and a fllmstrlp/ 
audio-cassette orientation. Although the assessment could be conducted .wi thou.t 
consultant help, in practice, many districts, state educational agencies, and 
multi-state or regional entities use the services of the Worldwide Educational and 
Research Institute in planning the assessment , developing Instruments, and pro- 

cessing the data. ; ' ' 

The Worldwide model furnishes a complete guide for a system approach to needs 
assessment and prbgram planning. It can be adapted to any grade level or size of 

\ 

.. system. 

A central feature of the mode Is the use of "concerns analysis," This is a 
method for Integrating perceptionsjand judgments with test scores and other ob- 
jective data, to arrive at a consefisus on need aceas. Detailed instructions are 
given for comparing facts, poUcifs, and values to arrive at statements of vali- 
dated needs. Widespread Involveint of the educational and larger compiunUy. 
Individual and group judgments o^' various 'kinds, and systemat Ic pregres^s through 
each stage are characteristics of the model. 

Worldwide provides flowcharts for each stage, specific gUldelfnes and alter- 
native methods for implementation, examples of instruments.'^and management through 
a quality assurance coBwrilttee. It does not supply of f-the-shel f- sets of goals or 
questionnaires and other- Instruments. ' - ^ ^ 

A master flowchart of thp ent 1 re ^ processes shown In Figure 9- Detailed ' 
flowcharts 'of each stage In 'tL assessment are Included in the 10 manuals. 

Insert Figure 9 

-- — 



50 



SERVICES AVAILABLE 

Many models can be used wi thou*-, external consultants; others depend on con- 
suUant help for management, data processing services, training sessions, or in- 
strument development. Battel le. Educational Systems Associates, Westinghouse 
Learning Cor' flon, and Worldwide, for example, offer su9h services on a fixed- 
*fee basis or for consultation fees plus costs of materials, data processing, and 
other materials and services needed. The experience of many school districts and 
.state educational e^encies indicates that it is often worth the cost to retain.a 
consultant to assist in managing the process, particularly when prepackaged In- 
struments and i^rocedures are not available. A list of management consultants. 
Individuals., and groups who offer needs assessment, planning, and evaluation 
services has been published In a directory by Western Educational Services (Re- 
sources for Educational Planning and Management IS?**). 

Workshops are available for the ?DK, CSE,' Worldwide,, and Fresno models. 
Kaufman and the EPIC group also offer workshops and consultant services of various 
- kinds to lmp1e«-,-.nt their general models, which are tailored to the specific needs 
of the cl lent. 

MODELS OF FUTIJRING AND THE FUTURES CONCEPT 

t 

The models and procedures discussed thus far are directed to assessing cur- 
rent needs.' Another approach to needs assessment, however, is to project what 
society will be like 20 or 30 years from now, and to use these possible future 
needs s the basis for present planning. 

In the last decade there has been a heightened interest in methods of pre- 
dicting the future. Elaborate studies have been undertaken, some using the Delphi 
technique, to predict what the world will probably be lik« around the year 2000. 

Recently educators have begun using various futuring techniques with citizens 
and planning committees not onl.y to predicf what mighty occur, but to dream up 
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alternative futures wUh thel r- pi'obable different consequences. 

Educators have not had much experience In using futuring materials at the 
local school level* and there has apparently been no real research to describe 
or measure the effect of futuring activities In school districts. 

Here are descriptions of four projects that have been assessing needs with 
an eyt on the future. 

Atlanta Assessment Project* ^ 

This project, now In Its third year, was designed to answer two questions: 

(1) What will young people In the Atlanta area need to know, be able to do, -.id 
value, in order to be able zo cope successfully with life in 1985 and thereafter? 

(2) Where are young people In the Atlanta area tc ^y in achieving these things? 
(Sweigert 1973) 

The-project established 21 educational goals for 1985 through a series of 
Delphi studies Involving nearly 1,100 community leaders, educators, and students. 
Specific objectives were developed to define each goal, and tests were constructed 
to measure those objectives. 

Tests will be administered to a sample of high school seniors, T7- and 18- 
year-old students at lower grade levels, and 17- and 18-year-old non-students, 
both graduates and dropouts of the Atlanta system. Assessment results will then 
be used tomalce administrative and instructibnal decisions to Improve education. 

In this project, the definition of "what should be" Is the minimal level of 
skills, knowledge, and att^ iudes considered essential for successfully coping with 
life in 1985. Both the sel f-ful 1 f 1 1 Iment of the individual and the person's func- 
tioning as a member of society are taken Into account. 

This project may be unique In that It combines futures techniques for estab- 



*lnformatlon on the project may be obtained from Dr. Ray Sweigert. Jr. , 
director, Atlanta Assessment Project, Atlanta (Georgia) Public Schools. 
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llshing goals, with the construction of tests specifically designed to measure 
the status of objectives which define those goals. 

Project Redesign 

The Pal^Alto (California) Unified School District has undertaken a massive 

/ 

/ 

Study engaging the schools and the community In planning for changes In the schools. 
The project used a variety of techniques— wri tten surveys, Interviews, futuring, 
and a budget priorities study, among others. Several summaries, mini-reports, and 
'technical papers have been published. The project has a* research as well as an 
operat lonal component. 

The needs assessment covered opinions on major curricular Issues; teaching 
methods; Issues In student growth and development; programs to meet specIdT needs ; 
attitudes toward the school district, teaching staff, and community; attitudes on 
selected Issues; and relationships with teachers, counselors, and administrators. 

The Futures Task Force took on two tasks: (1) to search the futures liter- 
ature for relevant descriptions of "whole** alternative futures and for various 
issues and Isolated predictions that would affect the future, and (2) to write 
a number of plausible issues, predictions, and future scenarios of Its own. 

The TaskTorce concluded that each person must struggle with the future and 
experience its implications In his/her own way. Therefore the project designed 
experiential exercises and training aids, so that participants might »»shapc their 
own visions of the rncst likely and the most desirable futures that could be con- 
sidered in educational planning.'* (McCol lough and others 197^) 

The publication on futuring by McCol lough and others Includes the Palo AltO 
case study in educational futuring, a bibliography, script and visuals for a 
tape/slide presentation, instructions for simulations and scenarios, synopses of 
three scenarios for the future, future Issues facing education, facts and trends 
with relevance for educational planning, and a section on values clarification 
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fn planning. 

The heart of the project !s 10 planning teams, which have operated like 
cottmisslons, studying the; district with the future In mind. At the present time, 
the results of the 10 tfeams' studies are being analyzed for recommendations on 
decision making, organizational structure, human relations and resources, educa- 
tional priorities, and fiscal constraints.* ^ 

Project Simu-School 

Slmu-School grew out of the work of a committee for education of the Amerl- 

\ 

can Institute of Architects, v^hlch saw the need to bring to the educational com- 
munity the same type of planning tools as are used In government and Industry. 
It was funded as a network 'of components to develop techniques which would assist - 
schools In planning efforts (Burr 1971). Components are In Chicago, Santa Clara 
County (California), and Dallas. 

The major emphasis Is on computer applications for handling data and pre- 
dicting the effects of decisions which are made and al ternatl vesr available. .Each 
component has developed specific too^, and position papers on asp^'cts of educa- 
tional planning are available. , . ' 

The Santa Clara County component has developed models and Issued reports on 
goal analysis procedures, designing future forms of educational facilities, organ- 
izing and planning for educational change, planning a career development center, 
housing patterns, residential, and educational Isolation and Its Influence on 
affluent youth, and a bibliography on educattonal^^lannlng, among others (Garman 
and Northall n.d., Candol I and Leu n.d.).«« 



*ror information on publications, write Tom McCollounh, director. Project Redesign, 
Palo Alto Unified School District, 25 Churchill Ave., Palo Alto, California 9^306. 

**lnformatlon on publications may be obtained from Dr. Lester W. Hunt, director. 
Office of the Superintendent of Schools, Santa Clara County, San Jose, California 
95110. " rj3 
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The Santa Clara County component has also provided consultant assistance to 
the Futures Task Force of Project Redesign, and published the significant docu- 
mentation of their work referred to earlier. * 

Prolect SWEP (Skyline West Educational P>an) 

This project was created by the Dallas (Texas) Independent School District 
to determln? what a secondary school should be like In the decades between 1980 
and 2000, and to provide a kind of universal model for the school of the future 
for the Dallas-Fort Worth "metroplex." The problem was to determine what the 
society of those two decades would be, then to design a cu/rlculum to meet that 
society (Skyline West Educational Plan, October 197'»)- 

The needs assessment stage used a variety of techniques. Data were gathered 
and synthesized. on student population trends, metroplex manpower needs, facility 
and site considerations, and analyses of the future society. Political, legal, 
and demographic facets of a multi-district schooling venture were considered. 
Forecasts of student enrollments, ethnicity of the population (Including analyses 
of fertility and birth rates), "holding power" of future scNjols, and forecasts 
of pupil and family metroplex socioeconomic status were included. 

Research methods used were a survey of the literature, a futures survey, two 
Delphi studies, on-site Inspection of facilities, and personal Interviews. 

A' conceptual model of a future school and planning specifications for Its 
implementation were evolved, and the model was applied to a hypothetical school 
site to test Its logic. It was concluded that the model would probably have uni- 
versal applicability. 
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' CHAPTER 6 
SPECIALIZED INSTRUMENTS AND TECHNIdUES 

. \ 

In\ad<ftl6n to the comprehensive models and surveys, there are Instruments 
to asses SN^eeds in specific areas. This chapter describes some of them, as well 
as some spec^lal data-gathering or analysis techniques. 

\ 

\ 

% INSTRUMEKTS FOR SPECIFIC AREAS 

In this section you will find Instruments suitable for needs assessment of 
speclflccurrlcular areas or for specific purposes. Appendix B contains Infor- 
mation on authors and publishers* 

ATTITUDE ASSESSMENT 

Norbar Attitude Assessment Survey, This survey is designed to gather Infor- 
mation -on the expressed feelings of students In grades K-8. It contains a 
standard list of 36 items, assessing attitudes toward reading, mathematics, 
school, and the self. An item bank is also available so that items from other 
areas can be substituted and the sur>«y can be tai lor-made. for the local sit-' 
uat'lon. Items in other lists include attitudes toward such matters as oral ex- 
pression, health, art, room environment, careers, social science, student body 
organization, and audiovisual resources. 

All items are phrased in the positive, most of them starting with "I like" 
or "I would like." Preprinted forms and optical scan answer sheets, on which 
faces with three different expressions are to be marked in niultl pie-choice fashion, 
can be ordered. 

' Student Opinion Inventory . A short student opinion inventory suitable for 

/ secondary schools is offered by the National Study of School Evaluation. It con- 
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sists of ik questions with mti'Tti pTe-chotce answers and, five open-ended questions, 
assessing student attitudes toward factilty. administration, students, curriculum. 
Instruction, school participation, a..d\chool Image. The Inventory may be hand 
scored, or machine scored by using optlc\scan sheets. Information Is provided 
on administration, scoring and Interpretation, and rella>i4ity and validity data. 

' CAREER EDUCATION AND COUNSELING 

Assessing career needs of learners . A learner-based needs assessment for 
the 8th grade was developed by the Northwest Regional Educational Laboratory In 
Portland, Oregon. It Includes career education, basic education, and special 
education. The Instrument Is In a bound pamphlet. Is formatted attractively, 
and uses language appealing to 8th 'grade students. 

Section 1 presents a list of 20 career areas from which students make judg- 
ments about what they would most like to do (High In the Sky), what they plan to 
try for. and what they expect to do. Section 2 assesses attitudes toward friends, 
teachers, and administrators, and how students perceive the expectations that 
others have of them. In Section 3 , students mark on a slx-polnt scale their de. 
gree of agreement or disagreement with statements about the school library, their 
interests, and various attitudes toward self, schools, careers, marriage, parent- 
hood, and being a citizen. It also assesses their levels of knowledge about items 
related to careers. 

priorit y Counseling Survey . The Priority Counseling survey has been used to 
assess needs for improving guidance services In California schools. Over 55,000 
students m grades 6, 8, 10. T2, community colleges, and adult education were 
surveyed. 

The survey has 25 items in which students select options from lists of 6 to 
12. Questions relate to what areas students' do their best work In, where they 
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need the most help, thetr hobbles, their sources of Information on abilities, and 
Interests. Questions on favorite school subjects, leisure time, and career plan- 
ning are Included. Five optional questions may be formulated by the survey ad- 
mlnfstr^or to obtain additional InforTfetlon on guidance, extracurricular activi- 
ties, or the curriculum. _ * 

The Survey also provides a list of occupations organized Into 12 career 
clusters, and the students select occupations about which they wish to have, more 
Information. Thus, the survey data can be used directly by counselors and career 
Information specialists In planning programs of career education. 

MULTICULTURAL EDUCATION 

The Instruments described In thts^-sectlon were developed for evaluation pur- 
poses, not needs assessment. Nevertheless, they would be useful In probing Into 
student and staff attitudes and other needs related to multicultural education, 
either as content or as part of school climate. 

Evaluation Guidelines for Multicultural/Multiracial Education . Two short 
opinlonnalrcs, one for students. and one for teachers, published by the Nations? 
Study of School Evaluation, may be used to assess needs In multicultural educa- 
In secondary schools. The publication contains guidelines and checklists for 
evaluating an existing mulUcultural program In the school. Thfe two opinlonnal res 
may be ordered separately. 

PRIME . Program Research In Integrated Multiethnic Education was developed 
and extensively field tested In a three-year research program at the University 
of California, Riverside, to assist school districts In evaluating the extent to 
which desegregated elementary schools are achieving an Integrated educational 
program. The Information can be used to assess status In developing an integrated 
school and to chart changes over time. Q2 
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PRIME consists of a model of cultural integration, questionnaires, and a 
computerized program which prints out school- and district-level profiles. , The 
target group is the elementary school, not the individual child. 

The procedures used in PRIME are appropriate only for desegregated schools, 
which are operationally defined as having a minimum of 10 children In at leost 
two different ethnic groups enrolled in the grades selected for the sample. The 
assessment Is, done at grades 3 and/or 6. The procedures cover two aspects of 
the Integration process: cultural integration and structural integration. 

Data gathered are teacher ratings of pupils, pupil se If -assessment , and 
statistical information. Publications include a training manual for data col- 
lection "and a technical manual containing reliability and validity data. 

1 

For each participating elementary school, thel district- receives a compre- 
hens.lve profile of that school on Individual measures, a summary profile of 
each school on six dimensions, and a district aggregate of data. Districts can 

i 

use cross-sectional data, or repeat the needs assessment annually for a longi- 

tudlnal study. The data can be applied directly ito planning multiethnic pro- 

I 

grams. | 

It is not known at this time whether or to what extent the PRIME model can 
be used in the future outside of California, slrjce the funding for the research - 
has ceased. Present Indications are that districts outside of California would 
not be able to use the model unless the data c^uld be furnished to the Univer- 
sity for research purposes. Consultants from|>RlME staff would have to train 
the local liaison person, and all data processing would be done at the Univer- 
sity of California, Riverside. | 

/ 

PSYCHOMOTOR ASSESSMENT / 

The Kephart Glen Haven Achievement Center, In cooperation with a task force 
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of the Virginia State Department of Education, has produced a psychomotor screen- 
ing Instrument that may be used by classroom teachers at the early elementary 
level to Ideiitt^- suspected deficiencies In psychomotor functioning. It has 
been pilot tested with chTldr.en In kindergarten through grade k and In special ^ 
primary classes for the educable mental ly, retarded (Psychomotor Needs Assessment 
of Virginia School Children 1973). 

The Instrument Is a checklist or Inventory of behavioral^haracterlst Ics. 
Teachers respond to 23 questions which are associated with five different psycho- 
motor functions of the child: internal organization, subdued activity, vision, 
overflow, and.fine motor, control The instrument is reported to have high reli- 
ability. 

The pul^llshed study gives extensive research Information on the instrument 
as well as on the Purdue Perceptual Motor Survey. Psychomotor abilities of chil- 
dren on a statewide stratified sample were analyzed by using a number of geo- 
graphic and demographic variables. 

The psychomotor domain is a complex Integration of many functional processes. 
Children must be able to organize themselves in relation to their environment 
and to monitor and organize this interaction within a time-space framework. The 
Virginia instrument shows how to assess the deficits in the processes of inter- 
action between the learner and the environment more accurately than is usually 
done. ----^^^ 

HEADING 

NAP . The national Right to Read program has developed a Right to Read Needs 
. Assessment Package to evaluate program, personnel, and pupil achievement in its 
school-based centers. The NAP provides guidelines for an in-depth investigation 
suitable for any grade level or content area. Right to Read offices In state 
educational agencies generally have this material and supplementary manuals on 
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hand, and may furnish copies on request. 

SCHOOL CLIMATE 

School Problem Area Survey , The Humai> Resources Research Organization has 
published a manual which contains two questionnaires for surveying mental health 
problems In schools. One Is for teachers and one for s,taff. The manual includes 
an Interview guide for gathering demographic Information on the schools from the 
principal, discussion of the rationale for the questionnaires, directions for 
using the Instruments, reliability and validity analysis, and directions for 
tabulation of the data (Taylor and others 197^). 

The instruments give a measure of school climate, v- / 

In the questionnaires, staff and students classify a list of potential pro- / 
blems on a six-point scale. Some Items are: *'The way the principal gets along/ 
wtth students**; ^'the amount of Influence student opinion has on the way the ^chool 
is run"; 'Maci^ of community Interest In the schools.'* / 

The Instruments were developed to be used In planning indirect services of 
a mental health facility in a school setting. However, they could assist a school 
principal and staff to assess the climate and mental health needs Qf the school, 
identify the most salient problems, and seel< aid using resources of the school 
system, or call upon outside consultants to assist in solving the problems. The 
data may also form the basis for developing special programs for groups of students, 
such as potential dropouts or drug users. 

SELF-ESTEEM 

Funny Faces Game . This early childhood self-esteem Inventory wa^ developed 
tit Operations Research, Incorporated. The game Is an Inventory of attitudes, 
feelings, and perceptions related to the situations and personal relationships 
at are commonly most Important in the lives of children from ages four or five 
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/ through prltnary grades. 

X The Instrument consists of a set of four color-coded car , with three faces 
on them, each set showing the faces in a different order. One face is smiling, 
one has no expression, and the third is a frowning face. The inventory^ is admin- 
istered Individually to each child. Children are given practice in discriminating 
the three faces on the cards and the teacher then reads 20 items. They respond 
to each item by pointing to one of the three faces on a card, indicating how they 

feel about the subject of each item. 

\ - * » 

Examples of items are: 
"Point to the face that shows how you feel about playing with toys ." 

"Point to the face that shows how you feel about putting on your 
shoes in the morning." # 

No information on field testing or norms was available froni the publisher. 

SPECIALIZED PROCEDURES , 

Here are some procedures found in various models which arc useful for gener- 

/ 

ating or ranking goals, for setting priorities, or Identifying critical need 
areas. They can be used with or without discrepancy analyses. Advantages and 
* disadvantages are summarized in Table 2, Chapter 12. 

CARD SORTS 

Many models use some type of card sorting to assign priorities to goals or 
to statements of needs. In this method, lists of goals or needs statements are 
placed on cards, one statement to a card. Individuals or small groups are then 

/ 

asked to sort the cards according to their order of importance. 

Materials for this method are (1) one set of goal cards for each individual 
or separate group, and (2) one set of priority cards; The CSE Elementary School 
Evaluation Kit, for example, uses five large cards with these labels: 1, Unim- 
portant/Irrelevant; 2, Marginally Important; 3, Average Importance; k. Moderately 
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Important; 5, Most Important. Goal card packs are randomly shuffled and each 
■goal card Is placed on one of the Importance cards until all have been sorted. 

Each group using the card sort tallies its goals, and the aggregate weights 
from all groups are derived. Results of the card sorts by various groups, such 
as students, parents, and the general community, may be compared. 

Different versions of the card sort are used in the TARGET model (see Delphi 
below) and PDK; it is optional in the Bucks County model. Participants usu- 
/ally find this an interesting way to make judgments of Importance, and to share 
In discussion about priorities. 

CRITICAL INCIDENT TECHNIQUE (Cl) 

. The Crl-tlcal Incident technique was formulated by Flanagan OSSk) to Identify 
critical factors In human performance in military situations. At the American 
Institutes for Research, which he established In the technique is used to 

solve practical problems In Industry, education, health, and community service 
(Flvars 1973). 

' CI Is a set of procedures for collecting direct observations of human b„- 
havlor-any observable human activity where the purpose or Intent of the act - 
seems fairly clear to the observer. When used for needs assessment, educators. 
^ students, and/or parents might be asked to recall a specific event or condition, 
observed recently, which makes them feel that something about their educational 
system needs improving. Incidents may be favorable, as well. 

CI has been used to identify needs In several school districts In California 
and Nevada (Campbell and Markle 1967). and procedures have been developed to col- 
lect .. categorl ze. and analyze critical incidents. 

The Critical Incident technique can be used by Itself or In conjunction - 
with other methods. The Fresno model uses a modified CI approach in its one-day 
conmunlty conference, described earlier. The Newport-Mesa (Cal Ifornla) ^School 
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.. District, possible the first to use CI In needs assessment, used it In the frame- 
work of a general system model. Behaviors were collected Indicating (0 what 
the schools were doing that showed the*y were doing an unsatisfactory job, and (2) 
what the schools were doing that showed they were doing a satisfactory job. Both 
types of behaviors were sorted into program areas, and objectives and expectancies 
were determined. In that study the technique res-lted in a bimodal. distribution; 
the extreme examples Were recalled, and the incidents in the -middle" were not. 
Therefore, It was somewhat difficult to arrive at priorities. 

CI can also be used in an exploratory phase before developing a needs assess- 
ment survey in an area about which you may have too little or conflicting infor- 
mation. The Instruments of the Bucks County model were constructed after an ex- 
tensive CI study. Any district could use the same process to investigate, for. 
example, school climate or breakdowns in communicatibn in the system. 

Implications of the Incidents are not always clear. For example: A high . 
school student is observed smoking just off campus; he pUts out his cigarette be- 
fore going on campus. Possible contradictory inferences are (1) 20od-he krows 
the rules; or (2) bad.-the school should be teaching him not to smoke.* • ^ 

DELPHI TECHNIQUE 

Several needs assessment ?tudies have employed the Delphi technique or a 
variation of it to achieve consensus on goals, concerns, or other items. The 
Delphi method was developed at the Rand Corporation to organize and share fore- 
casts about the future by experts (Helmer 1966). 

TvDically. the procedure includes a questionnaire mailed to respon- 
se' io'rel::in anonymous to one another Kesppndents i rst gen- 
erate several rather concise statements of events, and in the second 
rolld gtve e timates as to the probability of each event occurring at 
a given date in the future. Once the respondents have given the.r 

^' . c u . A'.^r-tlr nf research for Newport-Mesa Unified School District, 

^^prfJInfo:™?"; on ;r,:t?ca/prob,i of lnterpreti„9 crttica, .ncidents. 
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answeis, the responses are collated and returned to each respondent 
who then Is Invited to revise his estimates. The third-round respon- 
ses are made with the Knowledge of how others felt regarding the 
occurrence of each event. Again, the responses are assembled and 
reported back to the participants. If a respor'^nt »s estimate does 
not fall within the Interquartile range of all conjectures, he Is 
asked to justify his position, whether or not he wishes to change 
his position. (Weaver 1971, 261^ 

Its principal features are anonvmify of the respondents, iteration and con- 
trolled feedback, and statistical group re5»;onse» 

Among other uses, Delphi can be modlfiea to gather responses on critical ity 
of goals and areas of greatest need, and to arrive at consensus on present attain- 
ment of goals. In practice, the mailed questionnaire has not been used exten- 
sively In educational applications. In some variations, groups meet face to face, 
but methods are employed that ensure the anonymity of individual responses. The 
intention is to make certain that estimates reflect rational judgment, and that 
Individuals' perceptions will not be swayed by the influence of opinion leaders 
in the group. >' 

The Delphi technique has been used to assess future needs of Industrial 
education (Cunico 1974), and by the Institute of Government and PubWc Affairs, 
at the University of California, Los Angeles, to generate perspectives on changes 
in American education. It was also part of a three-phase statewide study in Wash- 
ington State (Rasp 1972). 

A study was also done at the University of Virginia to assess scientifically 
the needs, desires, and opinions of the clientele. The latter involved 400 re- 
spondents, rather than the usual 50 or fewer; the respondents were not necessarily 
e'xperts in the field, and the technique was u^ed to reach agreement on what should 
happen, rather than to predict what will happen (Cyphert and Gant 1971). 

A somewhat different application has been madt; by TARGET (To Assess Relevant 
Goals in Education Together) which combines the Delphi techn ique ,wi th a game pro- 
cedure (see Appendix B) . C9 
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The Information produced by the Delphi process In TARGET results in five 
indices: educational goal, quality of life, perceived achievement, priority, 
and education trecid. Statements for each index are derived from people meeting 
In groups, but wrl,tlng their own statements anonymously. Procedures are de- 
scribed for sorting, categorizing, and ranking t*e outputs, for each Index. 
/ ^ , * " ' 

/ The Delphi procedure is used In TARGET to obtain baseline data. The game 
aspect of TARGET is a yariatlon of the card sort procedure. In the game phase, 
larger 'numbers of oeople have an active role In furnishing Informatloa pertinent 
to de'clslon making about priority areas of Tieed. 

FAULT TREE ANALYSIS • • 

• Fault Tree Analysis (FTA) Is a method for predicting the m6st probable ways 
by which a system might fn order to redesign or monitor the system to pre- 

vent the failure from occurring (Stephens 1972, WItkIn and Stephens 1973). Its 
applications to education have been largely in analyzing the design of new pro- 
grams before they are Implemented, in formative evaluation of new educational 
programs or products, and is a part of management Informc-clon systems (Witkin 
1973 and 1971). 

Wherf FTA is used to derive areas of heed on a logical basis. It may be used 
by itself or in combination with models^for setting and ranking goals. It js 
most effective when used within the framework of a systematic approach tc planning 
and prob1em'%ol ving. • *' 

FTA method . Fault Tree Analysis begins with the statement of an Undeslred 
Event (UE) which you want to prevent from occurring in a system. (The UE can 
also be derived from an event that has already occurred, and'thatyou want to 
prevent from recurring.) The qualitative analysis Is accomplished through the 
development of a logic tree, consisting of a series of events formulated In a 
Step-by-step process, and related to all other events through logic gates. 
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^ Small groups interact to generate the Inputs. They can be trained In a day 
or two, and large trees of several hundred events can be developed in stages over 
one or two weel<s . 

Through the use of expert judgments, weightings of frequency ard importance 
are assigned to the events, and strategic paths are derived through quantitative 
means. The strategic paths can be visually traced out and will show any desired 
number of, "need" areas In the order of their probability of occurrence in the 
system. 

Figure 10 illustrates a small branch of a tree, with two types of logic 
gates and four types of Input events. 



Insert Figure 10 



In this Illustration, Event A (Box A), is some specified Undeslred Event 
(UE). Below it is an OR gate, meaning that either Event B o£ Event C could cause 
Event A. Below B 1 s and AND gate, so that both Event D and Event E would have 
to happen to cause Event B. However, Event C could be caused either by Event F 
or Event G. 

The different shapes of events at the bottom of this tree indicate particular 
characteristics of the events, and their relationship to the rest of the.system. 
All 6f these relationships are taken 'into consideration in analyzing what chains 
of events are most likely to occur to bring about the UE. Thus one can trace 

hundreds of complex events and conditions in a system in order to analyze the 

"real" needs as compared with the "apparent" needs. 

Applicat ions, FTA has been used to identify high priority needs in basic 

skills and in occupational preparation and guidance, among others. Jhe system 

It analyzes may be at the learner or the institutional ievpl . It may be a .chooi. 

a district, a state educational agency, or IdJ-ger entity. 
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Although some phases of Fault Tree Analysis bear a resemblence to the 
Critical Incident technique and to concerns analysis, FTA differs from them in 
these ways: (1) the step-by-step logical derivation of the events on the tree, 
(2) the precision of Inputs to the tree, (3) the capability of interrelating all 
events through logic gates, and* {k) the graphic displays which enable the analyst 
or the decision maker to Integrate several hundred events and to see their logi- 
cal relationships. 

Causal analysis . In addition to Identifying high priority need areas, FTA 
can analyze the most |>robable causes underlying the discrepancies which have 
been established. By determining the relative critical Ity of the causal chains 
for the most important needs, it gives information for later decisions on allo- 
cating^ resources and specific program planning. 

Sometimes the method turns up unexpected relationships. ^ For example, the 
Seattle School District, after doing a FTA of Its vocational education needs, allo- 
cated over $200,000 to Implementing recommendations for changes In the basic 
mathema,tlcs program-a relationship and result that probably would not have been 
realised through other types of needs assessment (Stephens 1972). 

/it has been found that a critical educational need Is more easily identified 
tha'n an educational need that has not reached critical proportions (McGrath 1970). 
Similarly, the developers of a needs assessment questionnaire for students re- 
port that in a school with no problems, reliability of the responses is likely 
to be low. But in a s'^ool with severe problems, reliability Is likely to be 
high (Taylor and others 197^, '♦D • 

It Is also easier to obtain consensus on what ought not_ to be than on what 
ought to be. FTA is one method that has been successful In identifying hidden 
or emerging needs before they reach high levels of critical fty, and In tracing 
causal relationships which In turn can lead to more cost/effective program plan- 
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MAGNITUDE EST I HAT ION SCALING 

A technique which provides ratio scale expressions of the relative Importance 
of school objectives has been developed and field tested at the Stanford Research 
Institute (Dell 1973, Dell and Heeland 1973, Dell \S7k) . The scaling technique 
determt^qes values that express the perceived relative wor th of objectives In 
ratio scaIeK rather than simple rankings or categorical ratings. It was field 
tested with patrdn^s of school districts In the San Francisco Bay Area. 

A set of kO goais». assembled by patrons of the schools, was evaluated by 
fathers and mothers of students, and faculty members from the participating schools. 
Proportional relationships (judged evaluation by patrons) between goals were 
developed for the total sample anjjl for sample subgroups. The procedure was as 
follows: 

Each respondent received a questlonnal re, and a list of kO goals, printed 
by computer so that each list contained the goals In a different random order. 
The first goal (referent) on each list was assigned a value of 50. fcach re- 
spondent compared each of the remaining goals with the referent and aligned values 
on a comparative basis. If a respondent felt the goal was twice as Important, 
as the referent goal, the value given was 100; If it was considered half, as im- 
portant, the value was 25. Any positive value, including fractions, could be 
used by the respondents. 

The geometric means of these scores multiplied by a constant resulted In 
objective evaluation scores; standard deviation of the logarithm ot responses 
gave a level of agreement score. These were computed for each objective as judged 
by the faculty, by all parents, and by selected subgroups of parents as determined 
from the stionnaire data. 

Respondents were also asked to consider the entire range of scores that they 
used In rating the objectives and needs and to indicate (!) the score above which 
the objectives and needs are so important that they should be given special emphasib 
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at the school, and (2) the score below which they arc of little or no value for 
the school. These scores then became the Upper Importance Threshold (UtT) and 
the Lower Importance Threshold (LIT) respectively. 

•The Magnitude Estimation Scale Is easy to administer. ., Sporlng and data pro- 
cessing are more difficult. The authors believe that the advantage of Magnitude 
Estimation Scaling over other methods Is this: 

In rating or scaling by categories (the usual method) , each objective must 
be compared with others In the category under conslderation--l .e. , when rating 
objectives on a five-point scale or In a card sort, the only point of reference 
the rater has is other statements or Items tha t are being rated. 

In Magnitude Estimation Scaling, however, each objective Is compared only , 
with the reference objective . Furthermore the results show the relative distance 
between objectives and not just the ranit order of objectives. Figure 11 illus- 
:rates this point with the objective evaluation scores of parents and faculty for 
four goal areas of science. 



Insert Figure 11 



PA I RED-WEIGHTING PROCEDURE 

This is a forced-choice method which can be used for setting priorities for 
different kinds of statements—goals, objectives, or needs . 

Suppose there are 10 goals to rate for Importance. Each rater Is given a 
list of the goal statements numbered' from 1 to 10, and a weighting form which 
compares each number with every other number. Goal 1 is compared in Importance 
with Goal 2. and a circle Is drawn around either 1 or 2 to Indicate the more 
Important. Siml larly,. Goal 1 Is compared with Goals 3. 5- . .10, and Independ- 
ent judgments are made for each pair. 
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The rater then moves to the next row and compares Goal #1 with Goals 3» 
5. . .10, again making judgments Independently for each pair. The process Is 
repeated until the last pair, 9-10, has been rated. ' 

Weights are determined thus: add the number of times Goal 1 has been cir- 
cled, and enter It on the line to the right of Row 1; then add up the number of 
times that Goal 2 has been circled, and enter It on Row 2; and so on, until all 
numbers have been added* 

Figure 12 Illustrates one rater^s completed form. Weights and ranks. have 
been added. 

/ 

7 

/ Insert Figure 12 

The ratings frof^i all who pa^rtlcipate are added together for each row, and 
composite weights are established. 

This forced-choice method is probably more precise than simple card sorts. 
The two procedures require different kinds of judgments, however. 

The paired-weighting procedure, like the card sort, can be used for judging 
the relative Importance of any set of statements. You might use lists of con- 
cerns or problems, or budget priorities, or currlcular areas, or anything else 
pertinent at some stage of an. assessment. 
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CHAPTER 7 

REGIONAL, STATE, AND HIGHER EDUCATION APPROACHES 
REGIONAL MODELS 

If you were to do a needs assessment at a regional level, you would use 
many of the same approaches and instruments as do local school districts. Que 
tionnalres, public opinion polls, and community meetings are all common. 

Regional assessments usually employ careful sampling techniques for surveys, 
in order to be sure that there is an adequate representation of all segments of 
the public concerned, as well as students and educators. For example, the Re- 
gional Education Service Agency of Appalachian Maryland did a needs assessment 
and feasibility study before setting up a regional educational television net- 
work to serve three Isolated rural communities (Hershkowitz 1973). A stratified 
sample bf 1,303 families was Interviewed from a total population of 199,553- 

The. Maryland study Included not only school-age and adult students, but 
"disadvantaged" families, educators, health and social service groups, polico 
and fire departments, and people from business and industry. The combined in- 
formation from rankings of educational goals, educational and business documents, 
interviews, and analysis of the availible resources, resulted in a comprehensive 
set of recommendations for regional ETV programming. (The critical Ity function 
designed for this study was explained in Chapter k, and illustrated In Figure i*.) 

The model and instruments used In this study are typical of multi -pronged . 
approaches suitable for large-scale assessments. Such efforts usually require 
outside consultant help on design and management, for best results. 

Other regional models and instruments came out of the ESEA, Title III PACE 
centers. From 1966 through 1970, the 21 regional centers in California did a 
good bit of the- pioneer work in developing needs assessment methodology, including 
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the first dfscrepfincy instruments. 

Two multi-county regional models weU one from the Tri-County Supplemen- 
tary Educational Service Center in Santaj Barbara, California (Blood and others 
1969), and the survey by the PACE-SIM Cdnter (1970). In the former, rating 
scales were used in teacher-parent inteifviews in a situation termed ''reverse- 
flow conferencing." (See Chapter 11 forj a description.) The PACE-SIM model 
illustrated a method for probing communilty as well as educational Issues, and 
analyzing the "perceptual" differences among groups in three counties. 

STATE EDUCATIONAL AGENCIES 

Stat^ departments of education perform needs assessments either for the pur- 
pose of making state-level decisions or to help districts with thel*- local plan- 
ning. Since 1969 when states were given the mandate under ESEA, Title III to 
develop needs assessment models as part of their state plans, a good deal of 
activity has taken place.' j 

At present, about one-third of the states have limited their needs assess- 
ment to statewide standardized testing, usually in the basic skills and in the 
Cognitive domain. Another one-third are at various stages in Implementing goal 
getting and .other needs assessment activities with broad-based community partici- 

I 

pation. The rest are "emerging" models. jThe ETS and Hershkowitz reports described 
In Chapter 1 are good sources of informatijon. - 

The Bureau of Educational Research anid Services at Arizona State University, 
Tempe, published a two-volume study contal^.ing a model for a planned Arizona 
statewide assessment (HcGrath 1970). A lcj-15 year plan was set up, but not im- 

t 

plemented. However, it became the forerunner of, .the present Arizona program. 

Similarly, Florida conducted a study under the combined leadership of public 
and private school educators, the university, and the State Department of Educa- 
tion (Kurth 1971). Tools were state- andidistrict-level socioeconomic, ethnic, 
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and educational data; a survey of educational practices and learner characteristics, 
from a random sample of schools; and a sample of opinions of seven population 
groups, Including employers of former students. The study concluded that "quality"- 
system inputs have only a minimal effect on ameliorating educational needs. 

In Florida, as in Arizona, there was a discontinuity between the earlier 
study and present efforts. Currently, the state educational agency in Florida 
Is field testing a very detailed conceptual design for a needs assessment system 
(Knight IS'/'*). The design presents a comprehensive mission, function, and task- 
analysis of the process, defined to the level of sub-tasl<s and alternative methods 
for eacK. flowcharts and narrative sections malte the step-by-step procedure 
explicit. 

The model is Intended to help local di str lets, assess their needs. Three 
" • \ . 

"products" are beinc developed: (1) the needs assessment system, (2) a training 

program to prepare users of the system, and (3) a cad r^ of trained State Depart- 
ment Education personnel to provide technical assistance to districts using the 
system. Provisions are included for feedbacic and revision of the model on the 
basis of information from the field. 

Wyoming began a long-range study in 1970 using the Worldwide model, but also 
Incorporating the goal-setting process of the PDK model. Twenty-one districts 
have been engaged in one way or another in workshops, problem Identification 
sessions, goal setting, speak-ups, surveys of community opinion, and a 40-hour 
training program for teachers, students, board members, and administrators in the 
instructional system approach to problem solving. Another eight or nine districts 

may be added by fall 1975- 

The study, which is still in progress at this writing, was undertaken for 
several reasons: accountability, long-range planning, and revision of the accre- 
ditation-evaluation process for the public schools of the state. 

Recent s.tttdTes undertaken by the Colorado and New Jersey state educational 
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agencies Illustrate two approaches to seeking widespread communfty fnput before 
setting state-level priorities. 

Colorado* has undertaken a statewide study of the educational and social 
needs of those adults (estimated at some 600,000) who are not now served by any 
educat'onal agency. Large influxes of newcomers to the state and a constantly 
shifting population made the study advisable. 

Different methods were used to reach different groups: (l) Interviews of 
a stratified sample of 8,000 potential users of educational services, (2) mail 
surveys with follow-up phone calls of all businesses and industries employing 
five or more persons, and (3) a survey of all agencies serving adults. / 

The project was scheduled to operate froin February ^SJh to late July 1975- 
Some 60 field coordinators have worked on It; over $250,000 were allocated to 
the project. After the project data are analyzed, the instruments wl 1 1 ' be avail- 
able to other states for their use. ; 
./ ' 

New Jersey. The "Our Schools" project of New Jersey has had two major com- 

> O 

ponents to date: (l) a determination of a formalized set of goals for the state, 

framed and ranked in a'serles of statewide conferences, and (2) a puljlic opinion 
survey utilizing personal interviews with a stratified sample of 1,325 residents 
(Opinion Research Corporation, February 1972). The data from these studies were 
integrated and are being used in Phase 2 to identify the cu'rrent status of the 
high- Importance goals. ' 

The study brought together some 5,000 citizens, educators, and students in 
two statewide conferences, a governor's conference, and 18 regional and 15 local 
conferences. Citizens Were also reached through the news media and local school 



*Pre-dissemination information about the study came from Dr. John Brennan, dirr 
ector of adult and conwunity education. Colorado State Department of Education 
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boards. A statewide coordinating body and needs assessment advisory council 
managed the effort, aided by local'and regional volunteers who coordinated their 
respective meetings. A kit of guidelines was produced for the local meetings. 

The goal -setting effort took about two years, and resulted In two prelim- 
inary statements of goals-one of 16 outcome goals, and one of nine process goals. 
An analysis of participants' ratings of both sets of goals was made both before 
and after the discussion at the governor's conference. 

The public opinion survey Interviewed a probability sample of 1,000 New Jer- 
sey residents age 16 and over, a subsample of 105 Spanish-speaking residents, and 
a sample of 225 persons who were then in the elementary and secondary schools or 
who had broad exposure to them. The Interviewing was done In a two-month period. 

Respondents were asked to rate each of the 16 outcome goals on a four-point 
scale of excellence and on a three-point scale of Importance. A major finding 
was that ratings of Importance and of perceived attainment were not highly cor- 
related (see Figure 5, referred to earlier). 

The respondents then rated the nine process goals. They were also asked 
what changes they would like to see in the schools, which goals- or procedures 
they would like to have implemented immediately, and many questions concerning 
their own knowledge, activities,, and habits. The questionnaire protocols, Item 
and content analyses, and technical Information are published in the report cited 
above. 

The Florida, Colorado, and New Jersey developments are not typical of most 
state-level assessments. We should make a distinction here between state assess- 
ment , which usually consists of standardized testing of basic skills, and state 
educational needs assessment , which relates goals to opinions and performance 
data about attainment of those goals. 

Regarding the state testing programs, voices are^being raised objecting to 
limiting the assessment to the cognitive domain, as is done In the majority of 
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state-level programs. This Is partly due to a lack of consensus on affective 
and psychonx)tor goals and Inadequate methods for determining need Indicators In 
those areas. Recently the Virginia State Department of Education has Issued guide- 
lines for assessing needs In the affective and psychomotor domains (Guidelines 
for Implementing and Relating the Virginia Needs Assessment Study to Standards 
of Quality and Objectives for Public SchooU In Virginia 1972-7A). 

The ETS report on state assessments raises many thorny Issues about testing 
and assessment, about the Inadequate base for decision making which rests on 
standardized testing, and about the potential ly undesirable Impact of state educa-^ 
tional agencies on local education. 

In that report. Beers and Campbell point out that state educational agencies 
are taking the leadership "In helping or coercing school administrators to an- 
swer to the public's cries for better Information about what children Icnow and. 
how well schools are doing their job." " 

A major problem appears at the point where goals are translated 
Into program objectives and Into data collection procedures. As 
a typical example, 27 of the 50 states have stated a goal con- 
cerned with human relations. However, only three states report 
that they have been- able to conduct an assessment of progress \^ 
toward such a goal. {ieers and Campbell 1973, 6) 

♦ 

HIGHER EDUCATION MODELS 

' Needs assessments In higher education are just beginning to emerge, and they 
may use any of the methods that have been discussed thus far. However, studies 
for community college or university needs often have a somewhat different focus 
and purpose from those done In elementary and secondary schools. Higher educa- 
tion studies are likely to look to the needs of the larger community— business, 
the professions, government, and new fields of research— for determining long- 
range goals and setting priorities, rather than to present and desired performance 
of students. Institutional goals may be emphasized as much as learner-oriented 
goals ((iulnnM97'«, Breuder 1973).- Currjculum assessment is related to ioh-market 
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opportunities and the needs of out-of-school adults. 

Here are some published survey Instruments, and a description of a few re- 
cent developments .In community college and university needs assessment efforts. 

Battel le . Battel le's Center for Improved Education has off-the-shelf sur- 
veys for community college use similar In concept and format to their Instruments 
for local district assessment. They were developed In cooperation with the league 
for Innovation In the Community College, and are based on Indicators classified 
under 12 areas of educational management: goals,, communicating, participative 
decision making, planning, evaluating. Instructing, staff development , -managing 
personnel relations, managing resources and materials, guidance, student services, 

and community services. 

The surveys are targeted for students, faculty, supportive staff, adml^ys- 
trators, and board members. They were field tested In three pilot colleges. The 
present surveys are revisions of earlier ones, with regroupings of function areas 
and restatements of the goals (see Appendix A). 

Institutional Goals Inventory (IGl) . .^ucat ional Testing Service developed 
the IGl as a tool to help college and university communities delineate goals and V 
establish priorities among them. It is a sel f-admlnlstered preprl nted , I nstrument 
consisting of statements of possible Institutional goals; 20 more may ^^e added by 
the college. It can be administered to students, faculty, administrators, cit- 
zens, legislators, or trustees. 

Respondents rate each goal both as they exist on campus (Is) and as respon- 
dents would like them to exist (Should Be), using a five-point scale of importance. 
ETS will score the forms and provide profiles of ratings for the 20 goal areas. 

Most of the statements are outcome goals for students in academic and Intel- 
lectual development, individual personal development, humanism/altruism, cultural/ 
aesthetic awareness, vocational preparation, traditional religiousness, advanced 
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training, research, meeting loc^il needs, public service, social egal i tarianism, 
and social criticism/activism, There are also process goals relating to campus 
climate and the educational process, innovation, off-campu^ learning, and account- 
ability (see Appendix ^) . 

According to ETS, the IGl has been used over 250 colleges and univer- 
sities since it was introduced in 1972. The IGl is also one component of the 
Flprlda Community Colleges* Consortium model (see below). 

Student Reactions to College (SRC) . Educational Testing Service also pub- 
lishes a 150-item questionnaire for assessing needs of s^^udents in community 
and junior colleges. It is Intended for studenj:^ who have been In coj/ege for 
at least one semester, and can be administered in one class period. Students 
rate the processes of Instruction, program planning, administrative affairs'and 
regulations, and out-of-class activities. Responses are on preprinted optical 
scan booklets.^ Scales vary with the questions: frequency of occurrence of an 
event, favor/oppose certain practices, and agreement/disagreement with a state-^ 
ment. 

ETS will score the oooklets c^'i provide computer printouts showing responses 
for subgroups. A comprehensive user's manual explains the items, gives directions 
for administration and use of the data, and furnishes technical information on 
reliability, validity, sampling, and construction of the instrument (see Appen- 
dix B). ( . 

> Ce ntral Flortda Community Colleges' Consortium . (Needs Assessment Project-- 
NAP.) A consortium of s^vSl^^col leges In central Florida has developed a model 
for assessing community occupy! onajj^^eeds through inter-govecnmental data anal- 

ysi's". Funding was through TInle II I of the Higher Education Act. Source docu- 

1 

I « ^ 

ments Include a description of- the nr.odel, a user's manual, and various project 
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reports (Tucker 1973, 197^a, 197^b, Rowel 1 1975).^ 

The primary purpose of the m6d^ was to compare community needs to the col- 
lege curriculum, classify them, and set priorities so that the educational sys- 
tem could assign the needs to the proper administrative unit for planned change 
and Implementation. The model outputs are: 

1. Ranking of the community's educational needs in order of importance, 

2. Development of alternative plaQs to meet those needs. 

3. Guidelines for budget allocations according to need priorities. 

k. Determifiation of economic feasibility of fulfiHing the need--cost/ 
ut i 11 ty analysi s . 

5. Development of a continuing, dynamic system to evaluate the educa- 
tional system^s effectiveness in meeting community needs. 

The project developed several modules which can be used independently or 
together. The heart of the model is a computerized process for assessing occu- 
pational needs for the service areas of the community colleges, using monthly 
status reports of jobs requested through the Florida State Employment Service. 
(The same method could be used in other states.) The Jobs are coded by occupa- 
tions, and weightings are, assigned based on net job openings for the month, 
average experience required, salary, and length of time the job "is open. Jobs 
In the occupational codes are then prioritized for "need"'' on the composite weight- 
' Ing factors, and matched as nearly as possible to curriculum programs in the col- 
lege ^ ' 

The simulation model was field tested In the Florida Junior College system 
at Jacksonville. Figure 13 shows the model. Baseline data from several sources 
are combined with the job market i nformat ion data, and an analysis is conducted 



nhe Center for 'Community Needs Assessment at the University of Florida sponsored 
a natlonal'conference on educational needs assessment January 22-2^, 1975, at 
Lake Buena Vista, Florida. Material^ from the conference and a list of publi- 
cations relating to the model may be obtained from Or. Katie D. Tucker, director, 
1212 S.W. Fifth Street, #8, Gainesville, Florida 32601. 
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over a two-year period. 



Insert Figure 13 



In this model, then, the needs are not primarily learner needs, but com- 
munity occupational needs which the college can relate to its currlculur planning 
and goals. This model can also provide for other bases of needs projections, 
such as population growth. 

The rationale for the model is that the community college must serve the 
needs of the immediate community. The assessment of ' occupat i onal needs was 
used as the prototype for developing methodology for the entire model. It Is 
intended to provide data on present and future occupational training require-- 
ments for local communities, place the job skills needs in a priority ranking, 
and relate the occupational need data to the labor market and educational cur- 
riculum. 

Figure 14 shows the relationshi ps "of several sources and types of data to 
the needs of job applicants, workers, people in training, and employers, and the 
relationship of the total data base to the needs assessment output. 



Insert Figure 14 



Other modules developed by colleges in the Consortium were: Institutional 
Goals-Setting model, Brevard Community College; Follow-Up Survey of Graduates, 
Lake City Community College; Summary of Student Characteristics, Central Florida 
Community College; Community Awareness Survey, Florida. Junior College at Jackson- 
ville; Employment Needs Survey, St. Johns River Junior College; Management Anal- 
ysis, Valencia Community College; and Faculty Evaluation, Florida Keys Community 



Col lege. 
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The survey Instrument used by Brevard was the ETS Institutional Goals In- 
ventory. Other Instruments were locally developed. 

Other community college studies . Another approach to assessing community 
college needs Is through the use of telecommunications, using feedback mechanisms 
to get the public's response to Issues presented on television. A study in which 
a college used its own UHF television station for this purpose is reported in 

Chapter 11.' 

The San Diego (California) Community College District has undertaken a sys- 
tematic assessme<»t of the needs of the 25,000 students in its four colleges, using 
the Kaufman model and the standard tools of system ana^lysi s. Foundation grants 
and district funding make it possible to use survey research methods with present 
and former students, a sample of various community subgroups, and all 1,150 full- 
time certificated and classified personnel of the district. The project is part 
of a master five-year plan which began in IS?**. 

An example of cooperative assessment is one at the De Anza Community College 
in Cupertino, California, which is assessing needs conjointly with local high 
schools In the region. 



A university cooperative study . The University of Illinois at Urbana has be- 
gun a joint needs assessment project with four community colleges-Rock Valley, 
Highland, KIshwaukee, and Sauk Valley. The purpose is to determine the univer- 
sity ' s role 1 n meet i ng the needs of citizens and groups In a nine-county region 
of northwestern Illinois. Funds have been requested under the Higher Education 
Cooperation Act to supplement Institutional funds for the endeavor. 

The assessment is the first step In planning cooperative regional delivery 
of nontraditional education. The Impetus for the project was that various national 
and state reports have found large percentages of the public dissatisfied with 
their present level of educational attainment and potential ly ready for an ;open- 
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university education. 

Since there is no consensus on how best to assess such needs, the university 
win use a number of different approaches. These include completed needs surveys 
previously done by consultant firms, data available from the community colleges, 
polling and other survey techniques, and analysis of selected professions for 
which the university trains Its graduates. 

Data from the field assessments wi 1 1 be used by aregional consultative coun- 
cil, which has representation from the participating institutions. The council 
will then divide responsibility for responses to the findings of the needs assess- 
ment.* 



Urbana. Mllnois 61801. 
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CHAPTER 8 

CONCEPTUAL AND THEORETICAL MODELS 

In Chapter 3, brief reference was made to four theoretical models-EPiC, . 
ESCO. Kaufman's, and Woodbury's. They will be described here because they II- 
lustrate concepts which may be useful should you desire to develop your own • 
approach « 

EPIC 

EPIC Diversified Systems Corporation In Tucson, Arizona, has developed an 
approach to needs assessment within a general evaluation model. It Is a synthe- 
sis of many approaches, offering a general point of view and suggesting alter- 
natives for the different stages. It Is student centered and hierarchical, pro- 
ceeding from the most general objectives to be assessed at the'state level, down 
through regional, district, school, and classroom levels. 

EPIC defines a learner need as "the situation that exists when actual learner 
performance Is below that which Is determined," and a need assessment as "the 
process of collecting information and the determination of what educational pro- 
grams are not bringing about the desired learner performances." (Needs Assessment 
1972, 2). The model advocates gathering both perceptions on priorities for goals, 
and test data on achievement of goals. 

Several boolclets are available from EPIC. Boolclet #8 on needs assessment 
and M on coding and selecting test items are the most relevant. The needs assess- 
ment boolc does not describe specific steps to be talcen, nor does it provide in- 
struments; however, it illustrates a three-dimensional approach toward developing 
learner goals and objectives from very general to very specific levels of con- 
creteness; so that assessments of performance could be made at appropriate levels. 
The EPIC staff worlds on a consulting basis with school districts and state 

: cs . 
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departments of education, and also engages on extensive training, offering work- 
shops and conferences both on-site and at the Tucson location. . 

ESCO 

One the earliest discrepancy models was the ESCO model, based on three 
assumptions: 

1. That the prime focus for an assessment of needs should be the 
learning objectives (0) toward which students are expected to 
work. 

2. That there are three principal reference groups-educators (E). 
students (S). and the consumers of the « ""^ 
and that their perceptions of any 9^«" I"'^"'"^ '^'j"'* 
critical in determining the extent to which the objective is 
functional within a given school system. 

3 When the members of these three reference groups tend to agree 
on Jhe importance of a learning objective, it Is functioning 
well within the school system. 

(Sweigert 1971, Sweigert and Kase 1971) 

The steps in the operation of the ESCO model are: 

1. Formulate learning objectives that are currently being taught 
In the school system. (E) 

2. Elicit perceptions of these objectives from students and pro- 
vide opportunity for them to add objectives. ISJ 

3. Take the objectives, or stratified random samples of t'hem. to 
representative members of appropriate consumer groups to deter- 
mine their views of the objectives. The consumers also express 
perceived deficiencies in levels of student achievement and 
suggest additional objectives. (C) 

Means and standard deviations of ratings on each skill area and objective 
are computed for each reference group, and the variances between and among groups 
are determined. These data' are used for ranking the Importance of objectives 

K 

within skill or knowledge areas. 

The model was' field tested In vocational education in a four-county region 
north of San Francisco. In the field test, the major criterion used for evaluating 
each learning objective was Its perceived potential usefulness in em£loj^. The 
ranking of the skill a^eas. or the Individual objectives within an drca. is the " 
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core of the analysis, and Is used In setting priorities for further action. 

Swelgert addresses the problem of what action should be taken in respect 
to skin areas or objectives for which there Is a high level of disagreement 
among the reference groups. He suggests using the data as a basis for planning, 
with the school-level people structuring a meeting between representatives of 
the different points of view. The data can be displayed in such a way as to 
show patterns of responses between and within various groups, and the reasons 
for the differences among patterns can be probed, 

Swelgert emphasizes that neither the ESCO model, or any other method of 

assessing needs, can make decisions. A model only provides information to be 

used in mak4ng decisions. Idea^ty, it should give the decision maker an increased 

\ 

number of options to exercise. 
KAUFMAN'S MODEL 

Kaufman's approach to needs assessment is within the framework of system 
analysis, with education regarded as a management process (Kaufman 1968 and 1972). 
His theoretical and practical applications of system analysis to educational 
planning and administration have been widely adopted. 

Kaufman gives general principles for a needs assessment, and suggests al- 
ternative procedures. But the specific instruments, data collection and analysis 
methods, and match/mismatch analysis are developed to fit the requirements of the 
educational agency. Consultant help Is available for the various stages. 



Implementer (teachers or parents). The Interrelationships among these three groups 
and the reconci latlon of their value systers mus^t.be taken Into account In the 
assessment. / 



His model is based on a three-dimensional structure: (1) the nature of the 
learner, (2) the nature of the knowledge to be acquired, and (3) the nature of the 



'ERIC 




86 



. 2. Determine the desired values oi partners as they perceive them. 

3. Determine the perceptions of e^ch partner concerning the values 
of the other partners, both cufrently and In the future. 

Determine the matches and mismatches between these differential 
current and future perceptions! of values to form a central part 
of the initial discrepancy anallysls. 

I (Kaufman 1972, 32) 

I 

Kaufi.ian also proposes a utility mcidel as a possible basis for needs assess- 
ment. In this model, the overall goal Ifor education Is the Independent survival 
of the learner. The Indicator of this jsurvival Is an economic one— survival is 
defined as "the point at which the Individual's consumption equals his/her pro- 
duction." Figure 15 illustrates a utility continuum; the midpoint of "Indepen- 
dent survival" is variable. 



Insert Figure 15 



In the "dependent survival" lone of the continuum, consumption is greater 
than production. In the "contributlorj zone" of the continuum, consumption is 

less than production. Any individual Is at some point on the continuum at any 

I 
I 

time. 

An educator using this model could design an educational system to achieve 
it least minimal outcomes for its learners by plotting where individuals currently 

I 

are and where they should be. Measurable discrepancies between actual and de- 
sired results could be derived. 

There are many implications of this approach. For one thing, learner "pro- 
ductions" would not necessarily be couched in the traditional academic currlcular 
or educational goals and objectives terms, but would be based on real-life sur- 
vival Indicators. Although the model; proposes that consumption and production 

I 

be measured by money spent and received (an economic Indicator), Kaufman points 
out that surviving and contrlbutlna linclude many humanistic requirements. 
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Under this model, the greater an i ndi vidual' s abi 1 i ty to realize 
his own uniqueness, the greater the possibility for him to be at 
or beyond the 'independent survival' point. Fully functioning, 
self.-actual izing people, will, it is suggested, contribute more, 
as nieasured by the criteria in this model, (^^^f^^ ,972, 37-8) 



WOODBURY'S MODEL 

Woodbury and others (1970) developed a research model for assessing state 
educational needs. The model, which drew on empirical evidence from the Virginia 
Needs Assessment Project, was designed to facilitate interstate comparisons and 
general i ?at ions . 

The strategy of the model is: (1) goals are derived from internal and ex- 
ternal sources-policies, recommendations, and perceptions related to the learner 
and to supportive and facilitative domains that support learning, (2) evidences 
of program are obtained from courses of study and other guidelines, statistics, 
funding, and incidence of programmatic efforts, (3) programmatic outcomes are 
evidenced by scores on achievement tests and rating scales, and by various sta- 
tistical Indices, and (k) needs are identified as absolute and relative gaps 
between the goals and evidences of programmatic effort and programmatic outcomes. 
The model Incorporates a design for periodic reassessment. 

A sample model for assessing affective needs at the learner level is shown 
In Figure 16. Pupil and teacher ratings of affective needs are combined with per- 
sonality-attitudes tests to produce two "prorfxjcts": (1) a set of affective needs 
as perceived by teachers, and (2) a set of student-perceived needs, validated 
through tests. Thus an "affective student population"^ is empirically determined. 



Insert Figure 16 



Similarly, Figure 17 illustrates the method for assessing affective needs at 
the facllltatlve-supportive level. Here the source of inputs Is personnel, sru- 
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or 



dents, and programs; these are analyzed for gaps between students receivlog 
not receiving counseling, and students participating or not in the facilities 
and programs. The "product" is a set of needs which relate to programs and per- 
sonnel but which support or facilitate work directly helping students in the 
affective domain. 



Insert Figure 17 



. Woodbury's model illustrates the synthesis of "hard data" (published person- 
ality test) with pupil self-perceptions and teacher ratings, to arrive at a 
composite assessment oriented to the learner. To assess the i nsti tut ional -level 
needs (faci 1 i tat i ve-support ive) he uses statistics on services and programs* 
available, integrating these with data from learner needs to arrive at support 
services required. 

The state of Virginia has built upon this and other studies to devise instru- 
ments for assessing pupil needs in the affective and psychomotor domains (see 
Chapter 6) . 
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CHAPTER 9 

CASE STUDIES OF SELECTED jMODELS 

To Illustrate the application of various approaches to needs assessment, 
here are some case studies of education systems which used different models- 
PDK, Worldwide. Fresno, and Westlnghouse. They typify current approaches, 
have varying degrees of prepackaged Instrumentation, and have been widely imple- 
mented. The sources were selected from lists .upplled by developers, and the 
Information was gathered through Interviews and written reports. A flfth,..ec- 
lectlc model, drawing on CSE and other sources. Is also Included. 

CASE 1. COMMUNITY INVOLVEMENT WITH PDK 

You are superintendent of a county school system serving four districts In 
the rural and unincorporated areas of a county bordering on the Appalachian 
Mountains. The county has a population of 109.000, mostly lower- and middle- 
Income workers in factories and towns. There are about 17.500 students In the 

four school districts. 

You would like to begin some long-range planning and provide a teacher's^ 
guide that will Identify critical skills and Instructional objectives. You decide 
to use the Phi Delta Kappa model, since It will actively Involve the community, 
together with students and teachers. In Identifying the needs. 

Wltl. ^. federal grant of $20,000, you begin by calling In two professors from 
the state university who are familiar with the PDK model. Principals attend a 
three-day leadership workshop to learn how to develop training strategies with 
their staffs. Two community meetings are held-one to rate the 18 goals of the 
model for Importance, and one to decide how well, the schools are meeting the goa>s. 
Twelth grade students and teachers also rate how well theS school^ are doing. The 
top priority goal area turns out to be the language arts. 

04 
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What happens after the needs assessnoent? For one thing, all teachers in the 
district are asked to submit a minimum of four performance objectives related to 
the most important goals. Nearly 100 teachers receive stipends to worl< on 
objectives and to prepare a final draft at the program level. ' 

This is a long-term project* You began the assessment in May 197^; by June 
1976 the teacher*s guide, identifying program objectives, should be completed. 
The goal of the project for the second year is to develop clear statements of 
^goals at the levels of program, critical skills, and Instruction. You also 
plan toVedo the needs assessment to see if the same discrepancies- persist. For 
1975*76 you will carrV out a program of testing to find out "where the student 
is'' in certain goal areas, such as reading and mathematics. 

The schools in these districts are organized with cutoff points at the build- 
ing levels in the ^th, 6th, 8th, and 12th grades. You are making sure that par-^ 
ticular attention Is given the pupils as they go from one school level to another. 

What benefits came out of the needs assessment? For one thing, county ad- 
ministrators are seriously addressing themselves- to curriculum planning. You 

think the project has been worthwhi le. 

Contact Person: William Phlllis, Superintendent of School 
boiumbiana County, Lisbon, Ohio 

CASE 2. INTENSIVE DISTRICT STUDY— WORLDWI DE APPROACH 

You| are coordinator of federal programs in an independent school district of 

/ 

22,000 students in the Northwest. At the request of the state department of 
education, you undertake a district-wide study of learners' needs. Test data are 
available on these students but you need much more information to aid In planning 
future programs and to set priorities. 

The model you pick is Worldwide, and with a $12,000 state grant, you retain 
staff of the Worldwide Education and Research Institute as consultants to the 
program. C5 
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You follow the model closely, appointing a 12-member quality assurance and 
steering committee representing the schools, the board, PTA, and parents advisory 
committee to the compensatory education program. 

Stage 1 — ]o4f of things are happening. The committee defines areas of con- 
cern In terms of values of the district. The consultants develop a 100-Item public 
opinion poll questionnaire. They choose a random sample to poll from adults in 
the community, district teachers and administrators, ^nd students. 

Stage 2~a concerns analysis Is made,\which results in a priority listing of 
learner groups whose needs are to be studied^ The order turns out to be elemen- 
tary, junior high, high school, preschool, and post-school. 

Stage S'^results of the poll have been Interpreted and a Concerns Analysis 
Conference is called. A, committee of interested citizens Is appointed for each ^ 
level of learners. The 15"person committees work separately for two days to study 
the concerns in detail and to make recommendations. "N. 

Stage '♦--you publish five wel 1 -documented books of the results of the study 
an^ the high priority needs, and present them to the district board of education. 
You make specific recommendations for action. Including one, that a follow-up study 
should be made. Plans are under way to budget this study for 1976. 

The district finds that an important concern Is the special need of adult 
learners. The validated need in this area, illustrating the Worldwide formula, . 



is: 
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Adult learners need spetlal encouragement, a variety 

of progranfs wl th easy access, and help In achieving a continuing 
process of self-development and self-realization. 

Target population ; All adults In the c^y. 

Criterion :. This need will be resolved/when (l) less than 5 percent 
of the adult population Is functionally Illiterate, (2) when 80 per^ 
cent of the schools are participating In* the' communi ty school pro- 
gram, d (3) when 15 percent of the adult population participates 
annually In programs of adult education. 

Critical Ity ; Important but not critical (#3). 

C8 
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Date need is to be resolved ; September 1, 1975. 
\ Did the mcKlel work?. Yes, but if you were to do it again > some changes woulti 

\ be made. Among other tnings, you would involve the staff more, reduce the length 
oKthe questionnaire, and do separate concerns analyses for teachers, for prin- 



cipalV. and for supeVvlsory personnel. You feel that all but one of the committees 



functioned^effectjvely , and the published reports show how much. work and effort 

went into the study. - 

' ^ Contact Person: Dr. Gerl Plum, Coordinator 

Boise (Idaho) Independent School District 

CASE 3. THE FRESNO COMMUNITY COf^ENCE IN ACTION ^ 

.' / ' V- 

You are supervisor of curriculum tn a mainly whit^, middle- and lower-middle- 

'/ 

class district tn Northern California, and you decide to do a needs assessment in 

one of the high schools and two elementary schools in the same attendance area 

* *" - • . 

to satisfy ESEA, Title I and early chi Idhood education program requirements. 

You choose the Fresno model because you want active community involvement in 

voicing concerns and setting g'oals. / (The example following is from the high school.) 

You set up a task force "^n February 1972, but the community conferences are 
not held until spring 197^. In* preparation, you invite a steering committee of 
17 parents and staff to plan/the conference. This group is later augmented to 35. 
Invitations go out to parjernts, staff, students, and the general community, and in 
May a one-day conference Is held In the cafeteria of the high school. 

At the conference, groups of five to six participants work together at tables, 
listing statements of what things are keeping the school from doing the job it 
should for students, and what the sdhool ought to be doing for students. Ideas 

I 

are wrl^tten on butcher paper and passed to other tables for ratings and comments. - j 
The rating process Is repeated four times. The resulting inven^tory of statements 
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and ratings is transferred to cards and sorted into categories. The meeting re 

for 
C7 



/ 

' ' ' / 

results In \h goal areas proposed for action* / 
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, You then turn over the results to a working committee of a dozen teachers, 
parents, and students who meet several times during the year to delineateithe 

i 

goals*more explicitly. They also meet with subcommittees of the schooTsf cur- 
riculum committee to translate the goals Into program objectives for curilculum/ 



planning. The high schopl principal coordinates these efforts. Consult^iants f^frqm 
the county schools office and elsewhere give volunteer assistance In so/-tlng^ut 
process from product goals and In facilitating group deliberations of ihe cpmmittee. 

In-deptj/ studies are begun In some areas of concern. One rteed Is Jor better 
.conmiunlcat.ron between parents and the school. After developing a go^l statement, 
the committee examines the school's existing communication practlce^^ formal and 
inforifial, probes for possible causes of the problem, and begins toyidentify inno- 
vative and creative ways of enhancing the conmiunicatlon between the school and all 
/parents, stressing more small-group Involvement and one-to-one interaction. 
^ %1 The total cost for the assessment is about $500 for all three schools. 

Did the model work? In general, yes. The Initial concerns conference took 
only one day, many areas were Identified for study, and the community had a chance/ 

for active Involvement. One year later, many of the goals derived from the need 

] - J- ' ■ ■ ' 

areas are being tran^ated into action. 

I' •■ . . 

On the Other hamd, some of the faculty feel that the concerns were not the 

"real" needs* nor i^at the parents attending the conference really represented the 

views of the commufiity. Since the priority lists contained mixtures of problems, 

solutions, and ne^ds, the working committee found It difficult to use the concerns 

J 

as a basis for prpgram planning. However, the work Is continuing, and you feel 

k 

that the needs a|sessment was In general successful. 

Contact Person: Edgardo E. Torres, Supervisor of Foreign Language, 

Science, and Math 



San Leandro (California) Unified School District 



CASE USING t|e WESTINGHOUSF SURVEY 

i 

You are superintendent of a school district of 2,500 students in a rural 
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community !n the Midwest having flye elementary schools, one Junior high and one 



, senior high school. Ten percent of the students are American Indian, the rest 
white. 

You want to establish di strict-wide goals and set priorities. After study/ing 
several models, you choose the Westlnghouse Learning Corporation off-the-shelf 
/ survey of 50 goals because It will gSve you Input frbm many people In a short 
/ period of time. Yours Is the first district In the state to use it. Eight ad- 
/ ^Llnistrators work with you as a team to coordinate the assessment. 

You administer the survey to a random sample of 200 students, 50 each in 
^ grades 9-12; to all 160 teachers and administrators, and to 200 parents selected 
(by the principals) for thei r involvement In school activities and knowledge of 
the schools* programs. The mailing to the community Is followed up by letters and 
^ * other means to ensure full participation. 

All three groups rate the goals for importance, degree of attainment, and 
responsibility of the schools. 

The needs assessment is conducted in a 25-day period during September and 
October 1973- The time span includes two weeks to prepare and administer the 
assessment, and turn-around time for scoring and computer printouts from Westing- 
house, 

Immediately following this, you spend a weekend studying the results and ^/ 
analyzing the discrepancy scored. Then you and the administrator team take a'^ 
two-day retreat to summarize and interpret the data, comparing the goal ratings 
with test scores and other Information that you have on goal attainment. 

You find a few puzzling results. For example, parents rate mathematics as 
the area of greatest concern, yet your standardized test scores show that pupils 
do better In math than In reading. You believe that parents had not understood 
the new math program, which was recently Installed, so they rated the area as low. 
Therefore yo^ adjust the goal priorities to take both opinions and test scores 
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Into account. 

Your team puts together all of the Informatfon, grouplfi^s imllar goals to- 
gether In clusters, and arrives at a set of l^* goal statements, listed In order 
of priority. The. first two are language arts/reading, and human awareness/self- 
Image. All of the goal areas are continued In the curriculum, but those with 
Idwer priorities on the needs assessment are maintained rather than Intensified, 
islnce apparently there Is no longer as high a need as formerly. 

You publish the priority list of goals, and turn them over to staff at the 
three division levels telementary, junior, and senior high) to develop In more 
detail. For the past year, teachers have been developing behavioral objectives 
for each goal at the program level. At the present time, you have just put all 
of their objectives Into a computer program that will give you printouts of be- 
havioral objectives for each course, all related to the major goal areas. 

- The needs assessment cost the district approximately $650, and you are gen- 
erally pleased with the results. You have two criticisms of the model: (l) the 
discrepancy analysis was not specific enough to discriminate some Items, (Westing- 
house has since corrected the program)., and (2) the mod^/does not call for group 
Interaction. Possibly there might have been more meanfng In the assessment to 
citizens If the dlstrlct-wlde Citizens Advisory Committee had been Involved, for 
example. 

However, the low cost, short time span, and ease of administration were Im- 
portant advantages, and you feel that you received good service and management 
\ of the assessment from West Inghouse. 

N 

\ Contact Person: Jerry Nichols, Superintendent 

South Tama (Iowa) Community School District 

^\ 

CASE 5.^ AN ECLECTIC MODEL 

You are assistant superintendent for curriculum and Instruction of a suburban 
district In the Middle West. The area has a population of 40,000, with a school 

d ■ 
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enrollment of about 12,000. You are familiar with many of the major needs assess- 
ment models, as vyell as the Delphi technique, and you have developed a combination 
model of your own. 

The procedure you worked out goes like this: 

1. A list of 60 potential school district objectives Is developed 
using the Delphi technique. Students , ci tizens , bus drivers, 
custodians, cooks, teachers, administrators, and the board of 
education are asked to suggest things the schools "should be 
doing" In 23 currlcular and, non-currlcular categories. Over 

1 ,000 statements are. received. These are reduced to '♦00, sorted 
In categories, and a subgroup of Indlvjduals selects up to two 
objectives for each category. 

Through a process of rating- these on a five-point scale, re- 
jecting those with low ratings, and refining the objective 
statements, a final list of 60 Is compiled. (These objecitlves 
and other Instruments are available for use elsewhere.) 

2. Objectives are ranked^ln importance using the decision matrix 
from the Evaluation I Workshop developed at the UCIJ^ Center 
for the Study of Evaluation. y 

3. .Curriculum areas, K-12, are ranked by small groups at the school- 

site level using the PDK method, but adding the questlon-of 
"Whose responsibility?" Averaging of data Is used Instead of a . 
consensus . 

I|. Target and program objectives are developed. Data from outcome 
evaluation are used. 

Standardized test data and historical Information are used only to confirm 
or refute the perceptions of groups. In Step 3, not to Identify "what is," as In 

the CSE model . , . 

You. have found that this combination model gives you the Information you 
need and you have given workshops on It In other parts of the country. 

Contact Person: Dr. Fred J. Rohde, Assistant Superintendent 

for Curriculum and Instruction 
Independent School District #62'» 
White Bear Lake, Minnesota. 

SUMMARY 

It Is evident that needs assessments vary conslde<ably in time, costs, 
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methods, and numbers of people Involved. 

ICl 



97 



The foregoing case studies and reports ^Others not included here indicate 
that the models that generate the most ^thuslasm among participants are those 
that require short periods of ^IrfvoTvement , that offer methods i for lUely group 
interaction, that have a simple system for Identifying discrepancies, and that 
have quickly visible and easily understood outputs. If goals or objectives are 
to be rated, the lUts should be rather short. Perceptions and subjective judg- 
ments are more likely to be used than object^lve data, and people appear satis- 
fied with them. 

Models that require systematic planning and Implementation over several 
months or years appear to succeed only If the educational agency can secure , 
highly competent project direction and management, and If those most directly 
Involved understand at all times what Is at stake and the Importance of their 
work. Open-ended and ''unstructured*' models— I.e., those that do not offer pre- 
packaged materials and surveys— are lessilk^ly to be adequately Implemented 
than tne structured types. 

Models also have a better chance of successful Implementation If In-service 
training and consultant help are available. 

Sophisticated features, such as the use of differentiated school norms or 
complex decision rules, are often omitted, and only the simpler features used. 

Models that rely mainly on perceptions of groups to arrive at discrepancies, 
and that use only one or two factors to Identify priorities among goals, are less 
likely than more complex models to Identify the "real" needs as distinct from 
the "apparent" needs. The high levels of community and staff Involvement and 
Interaction In some of these models, however, are seen by coordinators as prime 
benefits to the school regardless of other factors. 

' ' " ICS 
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CHAPTER 10 

PLANNING AND MANAGING THE NEEDS ASSESSMENT 

You have decided to conduct a needs assessment. Where do you start? What 
kind of planning must be done? And how should the process be managed? 

<A look at the variety of methods suggested by the various models Indicates 
that there is no one **rlght" way of doing it. Tru4, there are three or four 
components which many writers agree should be Included. These have been dis- 
cussed: setting goals, finding the present status of learners on those goals, 
identifying and analyzing the discrepancies, and setting priorities for action. 

Those might be called the "classical** steps. But the order of those steps 
varies among models, and s<me do not use a discrepancy analysis at all. And the 
research studies offer no empirical evidence that one way Is any more valid than 

another. / 
■ / 
Following a general system approach, this chapter outlines tbe major func- 
tions that would be applicable to any needs assessment situation, providing both 
structure and flexibility to meet the local case. 

ORGANIZING TO GET fHE JOB DONE 

Someone--a manager or management team—should take tfsponslbl Hty\^ for the 
usual management functions: planning, managing, supervising, Implementing, mon- 
itoring, evaluating and reporting. If the assessment is relatively simple, If 
you have prepackaged Instruments, and if external consultants will process and 
analyze the 3ata, only a coordinator may be needed. But for more comprehensive 
and longer term assessments a management team and committees are advisable. Some 
of the comprehensive models and kits give suggestions or guidelines for manage- 
ment which can be incorporated into your plan. \ 

1C3 
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WHO WILL DO THE WORK? . 

For best results, there should be wide representation In both the planning 
and Implementation stages of at least three groups: educators, students, and the 
lay public. The amounts and kinds of Involvement of these groups will differ 
with the functions to be performed, and the stages of the needs assessment/ In 
the planning stages', an advisory or steering committee may be needed. Task forces 
could assist in implementing the data collection and analysis. 

Some of the groups that usually participate In the needs assessment Itself 
are: faculty members, students, parents (randomly selected by grade level), ad- 
visory boards^, boards of education, PTA boards, citizens councils, community 
representatives, commercial or Industrial or service clubs, elected arid appointed 
officials. Depending on the purposes of the assessment, other groups could be 
added, such as nonteaching staff, citizens chosen by public opinion poll methods, 
students who have graduated from the school system, and employers of graduates 
or potential employees. 

SUCCESS AND FAILURE ANALYSIS 

There are two major ways to approacTi planning and management. They are com- 
plementary to each other. One Is based on analysis for successf-the other Is 
based on analysis to prevent fal lure . 

Experience has shown that,* even when plans are carefully made and carried 

out, a project may run Into unanticipated difficulties that could have been pre- 

I 

dieted and prevented by a '•failure** analysis. Furthermore, success analysis Is 
fnore profc|lematlc than analysis Is terms of fal lUre— that Is, the nonaccompllsh- 
ment of the system's purpose (Stephens and Rogers 1975). 

Therefore both approaches will be presented In this chapter: the general 
system approach, based Qn success analysis, and a system approach based on a mod- 
ified Fault Tree Analysis. 
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PLANNING TH€ ASSESSMENT USING SUCCESS ANALYSIS 

Regardless of the type of model to be used, these general ^teps could b'e 
performed for any needs assessment. The amount of effort and time spent on 
each will depend on how Important the results are to you, and the resources that 
, you can commit. 

1. Specify the purpose of the assessment, the group(s) whose needs 
are to be assessed, and thci -people who will use the Information. 
Secure commitment to the process and the purpose by all groups 
concerned. 

2. Perform a function ^ analysis of the process^ 

3. Determine strategies to be used. 

Plan the management of the process, including time, tasks, and 
talent needed. Estimate costs, set up budget, set time lines. 

5. Implement and monitor the strategies of the needs assessment 
plan. ' 

6. Interpret and evaluate the Information* 

/ 

7. Make decisions on priorities of critical needs to be addressed 
for short- and/or long-range planning. 

8. Evaluate the assessment. Compare the Information collected and 
decisions maJe to the objectives of the effort. 

9. Summarize , document, and report to decision makers. Dlssemi- 
nate Information from the assessment to the people concerned. 
In a form they can use* 

^ ^ 

POINTS TO CONSIDER AT EACH 'STAGE . 

A thorough consideration of each of the foregoing steps would entail devel- 

\ 

oping a new model and writing a manual for users* Sljice that is beyond the scope 
of this report, here are some salient points and questions pertinent to the nine 
stages* 

I . Purpose and commitment ^ 

What will the information be used for? What decisions will be made on the 
basis of the data? By whom? What people fm^st be satisfied, both within and out- 
O ICS 
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side of the system? (Groups within the system Include not only staff and students 
but the board of education, parents, and Immediate community. Groups outside of 
the system might be the state department of education, a funding source, or the 
* legislature.) 

The purposes of the assessment will govern such o,ther matters as the emphasis 
to be placed on generating and/or ranking goals or objectives, the kinds of data 
to be collected. Instruments or kits to be used, and the people who 11 parti- 
cipate in the data collection; 

Commitment of participants and of those who will later be asked to implement 
the recommendations is essential. Preliminary meetings of groups concerned or 
their representatives are highly desirable. 

Some questions that people usually raise are: How much of my time will this 
take? How much of the students' time? Over how long a period? Will It really 
do any good? Will t get to know the results? 

Even if a brief preprinted questionnaire or goal -rating Instrument Is to be 
used, with no community meetings, the participants need to know what they are 
committing themselves to during the assessment phase and after the needs assess- 
ment itself is over, 

.2. function analysis 

— 

What major functions must be performed? Models such as the PDK, CS£, Fresno, 
AeNAM, and Worldwide provide outlines and descriptions of the functions. Some 
Questions to answer are: What are the major steps to be taken? What are the 
antecedents and consequences of each? In the analysis you describe the infor- 
mation required, determine your potential sources of Information, determine how 
to retrieve and analyze existing information, and specify the kinds of new Infor- 
mation that must be required. 

At this stage, also, the output from each phase or function should be spec- 
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Ifled, Functional flowcharts showing the flow of major activities are useful, 
and can be used later for checking off each function as It Is completed (see Fig- 
ures 7> 8, and 9 for examples). . 

3 

3. Determine strategies 

Will a published model or Instrument be sufficient to meet th;te ^purposes of ^ 
this assessment,? If not, Include specifications for adapting exl;5tlrg Instruments 
or for designing them locally, as well as procedures for collecting and analyzing 
data. The PPNA paclcage Is a good source of Information. / 

Strategies to be used will depend largely on the purposes knd emphasis of 
the assessment and the resource^ available. They will also be/ affected' by what 
the school system has previously done. j 

Has the district already goals on which the assessment will be based? If 
so, strategies may center on methods for determining their Ifiportance and assess- 

Ing the extent to which they are being successfully achieved;. Or a norv-goal -based 

/ / — - ' 

model may be used, with the assessment, focusing on perceived areas of concern (see 
the Fresno, PPNA, or Dallas models). 

• Districts not having clearly articulated or formalized sets of goals may wish 
to begin with the goal-setting process usJng Worldwide, Ke|(ufman*s, or the ^^Our 
Schools'* approach of New Jersey, for example. Alternatively, one may use prepared 
lists of goals (PDK, CSE, Bucks County, Battel le, Westinghouse) and proceed with 
ratings and with gathering perceptual and performance data on them. 

If a needs assessment has not previously been conducted, a comprehensive, 
general approach to identifying and ranking needs "^n all areas, both learner-cen- 
tered and Institutional, Is probably In order. If some assessment has previously 
been done, however, it may be more pertinent to do anjn-depth study of specific 
areas of need, and to Identify priorities in them for program planning. In-service 
or resource allocation. Such areas might be multicultural education, vocational 
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and career education, counseling and guidance, reading, or meeting' t>ie ne^ds of 

certain groups of learners, such as handicapped or non-EngI Ish-speaklng children. 

/ 

The advantages and disadvantages of various method of goal setting and 
rating, community Involvement, data collection, and discrepancy analysis, as well 
as problems of ^ampllng and of Implementation ,/ wl 1 1 be considered In Chapter 12. 

/ 

k. Management and resources / 

It may be advisable to release someone from regular duties to act as project 

/ 

manager for the assessment ,/ If the district Is large and If many people are to be 

Involved. The manager Is/usually a director of research, director of planning, 

/ 

assistant superintendent/ for Instruction, coordinator of;federal projects, or a 

/ 

director of elementary /and secondary education, at the district level, At*the 

school site, the manager Is, typically the principal', although there are exceptions 

/ ^ ' 

At state agency levels and at universities, project managers are likely to be 

/' 

directors of plar^nlng or of research. 

/ 

The simplest models, with off-the-shelf Instruments, usually require only 
a codrdlnator/or facilitator, time lines of a few days to a month or two, arid a 
budget for materials only—usually under $500, and often less. 

The comprehensive, long-range .models might require a project coordinator or 
manager working with a management team, external consultant assistance, commit- 
ment of one to two years from start to finish, and costs running Into several 
hundreds of thousands of dollars. Between these extremes are many alternatives — 
again, depending on the purpose of the assessment, sources rfnd kinds of data to^ 
be gathered, numbers of participants, size of the target group, whether preprinted 
Instruments are to be used, computer services needed, and the like* 

Orientation sessions for those In charge are desirable* Some models have 

cassettes or fllmstrlps available (Fresnc, PPNA, Worldwide), or the developers 

* 

offer workshops (POK, Worldwide, EPIC, Kaufman's). 
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Case studies Indicate that a major management problem is setting realistic 
time lines and meeting target dates. Time overruns can be avoided by estimating 
time needed for each tasic, then building in additional time to take care of un- 
avoidable delays. y 

5. Implement strategies , ' 

For smooth implementation, there should be worl<shop sessions for group leaders 
or members of steering committees. This is particularly true on the longer range, 
more complex models, and where interviews or group Interaction are used. Coordi- 
nators of several. case studies report that they wish they had ^ad more time to 
train participants. ' .; 

A conmon problem Is that teachers may not be given enough notice before a 
questionnaire or test Is to be administered. Or a survey may >e conducted the 
same week that standard Ized .tests are being given. This is a crucial area where 
careful replanning for success should be supplemented by analysis for potential 
failure. 

The management system should include methods for monitoring the various ' 
stages of the assessment, and for holding specific people accountable for outputs 
or documents in each st^e. It Is aUo advisable to build in "backup systems" 
or alternative methods , [especial ly In the long-term assessment efforts, to com- 
pensate for problems that may. arise. The Fault Tree Analysis section below will 
discuss these points further. ' 

6. Interpret -and evaluate the information 

The major concern In this phase is to have a structure within which all kinds 
of information col lected— demographic data, test scores, people's perceptions, and 
other data— can be meaningfully Interrelated and Interpreted. 

Here again the question Is, what Is the purpose of the assessment? What 



decisions can or should be made on the basis of the data? 
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'-^•rpretatlon must be made of (1) discrepancies between desired conditions / 
and .--nt status, and (2) discrepant perceptions among parents, 5tudef\ts, teach- ~ 
ers, and other participants. ^ 

In order to Interpret such discrepancies It may be^ecessary to probe further--- 
to analyze causes of the discrepancies or to rfelate one type of discrepant Infor*- 
mat I on to another. Perhaps It will be necessary to conduct a second^level assess*- 
ment of critical areas, or to follow up survey results with selected group Inter- 
views. 

Models which offer decision rules based on several factors (e.g., CSE)- pro- 
vide a better basis . for Interpreting the data than do those based on simple dif- 
* ferences between group scores or ranks on goals. ' 

7. Hake declclons on priorities 

^ Once the data are tnte^rpreted, the manager or t^am must decide which "needs'* 

should be chosen for action, such as curriculum planning or change. At this stage. 
It may be evident that the highest priority needs Identified are not susceptible 

\ to solution, taking Into account existing resources or other constraints. There- 
for*^ other criteria, must be considered. The report of the Maryland ETV study 

* (HershkQwItz 1973) ^nd the guldebobk to the CSE Kit discuss this matter In detail. 

Another matter to consider Is whether the needs assessment will give suf- 
, . /' 

ficlent .Information for action; Educators who furnished Information from case 

studies have stated that,, when goals are stated too broadly, It Is difficult to 
know what the priorities mean. 

#, 

8. Evaluate the assessment 

Host needs assessments studied h4ve no bullt-ln methods of evaluation, nor 
have most usfers conducted evaluations. -Even where materials and procedures have 
been extensively field tested for reliability and validity, such as the CSE, PRIME, 
and PPNA,« the . Implementation of the model In your system shpuld be evaluated. Both 
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process and product evaluation are recommended. i 

Process evaluation might ask for feedback from a sample of participants as 
to their understanding of and attitudes toward the process. It could also In- 
clude an evaluation of the degree to which the original plans were adhered to, 
stateWnts of what did not work, and recommendations for revised procedures or 
Instruments when the assessment Is repeatecT. 

Product evaluation would compare the results actually achieved with the pur- 
poses and objectives of the assessment that were stated In Step 1. 

9. Summarize, document, report, dlssemlBate 

Many needs assessment^ end In written documents whlch'are never Implemented. 
Documentation and dissemination have at least three major uses: to Inform de- 
cision makers, to maintain a record for future action, and to give feedback to 
, the participants. 

Documents might contain summaries of the assessment, including procedures 
atid instruments Used; lists of goals and objectives generated, tables and graphs 
showing analyses of data, and recommendations for action. 

If the needs assessment results are to be used by di fferent.g roups , for dif- 
ferent purposes,, separate reports could be issued and tailored to each group, 
with only the most relevant information Included In each. Experience has shown 
■ that people who participate want to know the results of their efforts. In addition 
to written documents, the mass media may be used to communicate the findings. This 
would be particularly desirable if comn.unlty support Is required to Initiate or 
sustain curricular changes or other action. 

A frequently heard criticism of needs assessment is that nothing has happened 
as a result of previous assessments. The documentation of the""assessment , if done 
well, will provide not only clear recommendations, but some mechanism for assuring 
• commitment of educational and community leaders to use the results as Intended. 

Ill 
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PLANNING THE ASSESSMEnI TO PREVENT FAILURE-FAULT TREE ANALYSIS 



Fau 



It might appear thlt careful planning for success will prevent failures. 
Research and experience Vave shown that this is not the case, and that "failure" 

Is not simply the opposiL of "success." The purpose In analyzing for potential , 

I 

modes of failure Is that |t alerts the administrator to areas or functions that 

should be carefully monitored or redesigned, and tbus a more successful a&sfcbi 

'} . ^ • 

ment will be possible. \ , \ 

I \ 

Concurrently with -the tlla||ilng of the^rfeeds asS|essment, particularly Steps 

]-k above, a Fault Tree Analysis can be conducted. An abbreviated form galled 

It Hazard Analysis, which \>es not require the^tij^l drawing of trees or 

quantifying to derive strategll paths, may be used to anticipate or Identify* 

S ^ „-u-.„ , 

potential problems that might olcur to prevent a Successful needs assessment. . 
Two kinds of failures are analyzed: failures of design and failures of Imple- 

mentation. \ i 

\ Design failures .' Some quest f^ns mlght^'be^^J^bat-eVcnts could cause the de- 
siqn to be Inadequate to achieve the^s^r^SresuI ts? What failures might occur 
« due to. failures of or Inadequacies In goal setting? of ranking goals? of methods 
used to arrive at discrepancies? What problem* might arise In the nature of In- 
struments used? In the data gathering methods? In the methods of analysis? 
Could .any of the procedures have undesirable side effects? If a model or Instru- 
^yment must be adapted for local use, what distortions might result In the Inter- 
\ 

pretatlon? • ^ 

Implementation failures . What events or conditions could cause the assess- 
ment to fall to be Implemented as designed? What factors Internal or external to 
the system might prevent any^^actlvltles from being accomplished? What kinds of 
failures might be anticipated due to Involving or not Involving certain groups? 
In sustaining their Interest? 

What failures might occur due to Insufficient time, money, people, or other- 
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resources? to Inappropriate timing? to Inappropriate use of people? What would 
be the consequences of such failures for the total assessment? What problems 
might arise In collecting or processing the data? In Interpreting the results? 
in communicating the results? 

The foregoing analysis cah be performed In a session of two to three hours 
by representatives of all groups Involved in managing and Implementing the assess- 
ment. Potential failure events can be arranged In a table like the following: 



Function 



Potential 
Fat lure 



Possible Causes 
(Antecedent Events) 



Possible Consequences 
(Effect on Other Events) 



Crlticallty 



In Column 1 are listed the major functions to be performed In the needs assess- 
ment. Failures, antecedents, and consequences for each function are listed In 
Columns 2-4. When all major functions have been analyzed, critlcaltty estimates 
can be assigned to the failures, based on the effect these would have on the total 
effort. Estimates might be assigned on a three-point scale: 1 » highly critical, 
2 » moderately critical, 3 » minimally critical. Major attention would be placed 
on the high crlticallty potential failures, and on the functions with the highest 
number of failures receiving crlticallty estimates of 1 or 2. 

Redesigning or monitoring the assessment . Returning to the design and the 
methofls for Implementation, then, back-up and monitoring systems can be built In 
where necessary, resources added, or design changes made. The Fault Hazard Analysis 
Itself may be retained for use by the project manager as a checklist and for moni- 
toring the assessment, with copies given to those responsible for critical func- 
tions. #j 



ERLC 



/ 

/ 

Faatt Hazard Analysis Is only one stage of the fault tree process. Where 
Important and costly decisions are at stake as the result of- the. needs assessment. 
It Is worthwhile. to spend an adequate time In preplanning, using both success 
and failure analysis, and perhaps performing a full-scale Fault Tree Analysis. 

In practice, however, It has been found that even a cursory consideration 
of potential hazards can Illuminate unforeseen areas and Increase the accuracy 
of the planning. Furthermore, field tests have shown that the fault tree approach 
has high predictive value, and that the results produce more than adequate "pay- 
off" for the time and effort expended (Wltkln 1973). 
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CHAPTER 11 

COMMUNICATION STRATEGIES 

lipw much should people be involved in face-to-face Interaction during the 

process of needs assessment? - 

There is no one answer to that question. It depends on your school. and 
community situation, whether you've done a needs assessment in the past, what 
kinds of Information you want, how much time and money you have, and the potential 
values In the communication process itself* 

NON- INTERACTIVE STRATEGIES 

Probably the sinq>lest and quickest way to obtain a lot of information from 
many people Is through the use of written surveys, questionnaires, or rating 
scales. Goals can be rated for Importance and attainment, and people can express 
their attitudes and preferences without any group meetings at all (see the Bat-- 
telle, Bucks County, Westinghouse, ACNAM, IGI, and the career and counseling sur- 
veys referred to earlier). 

The Delphi technique, which uses written communication In two or three stages 
may also He used to assess needs without bringing people together. Also, surveys 
or rating scales can be administered quickly In groups, such as school classes or 
meetings, without any group Interaction. 

Advantages of written communication are: (1) you can survey many people over 
a wide geographical area, (2) much data can be gathered In a relatively short time 
(3) with structured instruments, there Is less chance for sidetracking and Ir- 
relevant Inputs, and (M) the process Is relatively easj/ to manage. 

On the other hand, you may find positive benefits In having some degree of 
group Interaction. Not only In planning, but during the data-gathering phase, 
various communication settings and strategies are helpful to involve people In 
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thlniTlng actively and creatively about the needs of the system. 

COMMUNICATION METHODS 

Here are some communication strategies, mostly Interactive, that have been 
used successfully In one or more phases of needs assessment. The numbers of 
people Involved and the amount of Interactfon art. somewhat Independent of each 
other. Figure 18 summarizes both written and oral methods on two dimensions— 
from no group Interaction to very high group Interaction, and from few people In- 
volved to many people Involved. 



Insert Figure 18 



Public oglnlon polls . Gish (1972) tested the feasibility of public opinion 
polling on the Gal lup/Ketterlng model at the local district level. He designed 
a questionnaire and a method that could be replicated locally, at a cost o'f 
$2,000 to $10,000, If'done "In house." Many regional and statewide studies have 
Incorporated such public opinion polls In their assessments, for example in 
Maryland, New Jersey, and Colorado. 

Speak-ups . One of the earliest large-scale community Involvement assess- 
ments was done In Fresno. California, with 10.000 participants from the community 
(Speak-Up 1968). The speak-up was promoted through the mass media, talks to com- 
munity and civic organizations,' and PTA councils. The method used neighborhood 
"discussion parties," each with an average of six to eight people attending. 

Discussion leaders were asked to "hold a small Informal party. Invite a 
few. . .people to discuss aims and objectives for our public school system." The 
project provided questions to guide the discussion, and a discussion leader's' 
and a participant's guide. 

Charrette . Some communities have adapted the Charrette to needs assessment. 
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Charrette Is a variation of a group process In which cofrnminl ty groups design new 
facilities. Representatives of all parties having responsibility for or con- 
nection with the project ar.e Involved from the beginning. Procedures have been 
developed to arrive at all decisions openly, to communicate the reasons for 
accepting or rej^c^+ng a proposal, to generate as many creative solutions as 
possible In a short period of time, develop them, and come to some basic decision. 

G|pups do not vote, but the final rounds Involve debating the merits of 
each proposal In an open meeting. Finally, the Char'rette makes as many final 
declsfons as possible through common agreement, and designs a process for re- 
solving proposals that are deadlocked (Hylecralne n.d., 189-91) • 

Peccolo (1971), In a three-county study In Tennessee, evaluated the Char- 
rette and found It effective for Identifying educational needs and planning new 
programs. 

Focus Interviews. The focus interview Is a group Interview method, useful 
for gathering In-depth Information on concerns and goals. Usually two Inter- 
viewers are present to guide the group, but not to Interfere with their discussion. 
They tape the proceedings and also^takes notes. Immediately after the session 
the Interviewers transcribe the tapes and analyze the contents. Ideas brought 
up In the Interview are categorized, and the classification scheme Is reviewed 
by both Interviewers to eliminate bias. , ^ 

Sessions typically Include eight to twelve participants, and lait about two 
hours. Many such sessions can be held to reach large nunrfjers of people, and the 
results of the different groups are compared and synthesized. 

Focus Interviews were used to Identify the educational needs of American In- 
dian students In Arizona (Consulting Services Corporation 1969), and In a state- 
wide study In Washington (Consulting Services Corporation 1970). In the latter, 
3k group Interviews were held to probe Into needs that becam^ evident from a 
statewide questionnaire. jL!l7 
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Blackwell and Jonlak (\97^) conducted three research studies to refine the 
method. They attcn^ted to elicit specific goals for education from parents of 
heterogeneous background with children of high school age. They found that the 
method worked, that the parents' goals for secondary education were based on the 
personal experiences of themselves and their children, arid that the parents were 
not concerned for Innovating educational changes. 

Teleconwunlcatlons . In order to reach groups not adequately served by. the ., 
schools, a UHF television station owned and operated by a community college dis- 

o 

trlct In Southern California used videotaped panel discussions. . 

To determine the educational and public service needs of the area, the dis- 
trict held meetings of 10 discussion panels: professional and white-collar work- 
ers, Hexican-Amerlcans, senior citizens, blue-collar workers, handicapped 5th 
and 6Jth grade children, and college-level educators. Discussions were videotaped 
at the KOCE-TV studios. Five groups of community lay persons Jtotal 15^) were 
later Invited to the studios to review the tapes and to provide reactions to the 
opinions of the original panel participants. 

The method resulted In specific lists of both needs and solutions; the con- 
clusion was that: 

There Is a heed for grassroots Involvement In developing educa- 
tional and public service activities. Sooner or later every 
group with which we talked brought out the necessity for person- 
al contact and human-to-human Interface as Important components 
of any program devised to meet the needs of Orange County. 

(KOCE-TV Needs Assessment Surveys W^, 31) 

' They wanted close and meaningful liaison with the community, not rubber stamping 
of juwnmunlty advisory groups. 

Telecommunication was an Important feature of the goal-setting phase of the 
New Jersey State needs assessment, which used all available mass media to promote 
support and cooperation for the project. A special campaign was Instituted, using 
television commercials, an elght-mlnute orientation film, radio spot announcements, 
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newspaper releases, and special publications and reports, Including Sisveral offi- 
cial coftnunlcatlons from the Commissioner of Education to all local school dis- 
tricts. 

The use of mass media to encourage a flow of Ideas fnd Information Into the 
educational system Is In sharp contract to past uses, which have been largely 
limited to disseminating Information when educators solicited support for an up- 
coming election or bond Issye. 

Telephone Interviews . Project E.A.S.T. (Mikol and Hafeman 1973) used tele- 
phone Interviews to reach a random sample of parents and the general community. 
The technique allowed the staff to reach nearly everyone In the sample with less 
time and effort than through home visits. The parent sample was drawn from an 
alphabetical list of students from each school. The community sample was drawn 
from the city directory. Home visits were made If there was no phone. 

Interviewers were paid and trained. For ranking goals on a parent ques- 
tlonnaire, the forms were mailed ahead of time and respondents were asked to 
rank them before the phone calls. There were very few refusals to answer. Inter- 
viewers received excellent answers to open-ended questions, which gave them nearly 
all the lnf6rmatlon needed to set priorities. 

A dlsadvantage^f the phone Interview Is that questions must be. structured 
in a particular way. The project coordinator reports that If she were to do It 
again, she would make the fo(l lowing changes: (1) shorten the Interviews greatly. 
(2) rely mainly on a few open-ended questions, (3) use as small a sample as Is 

scientifically valid and take special ciare to reach each sampled household, W 

- ■■^ t 

not try to sample high school graduates. Only about one-third of the one-year 
graduates and one-fourth of the five-year gradua^s returned the questionnaire.* 



*Personal communlcatlon/joyce Mlkol, Title I coordinator, Madison (Wisconsin) 
Public Schools, May 1975- 
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Concerns conferences . The Concerns Analysis Conference of the Worldwide 
model Isia structured group process for reviewing and Integrating facts, values, 
and policies In order to arrive at carefully formulated objectives. The use of 
preparetf forms, charting, and other techniques provides a combination of free 



Interchange with logical movement of the group toward decision. 

The Fresno model also Identifies concerns using a structured group process, 
which, was described earllei^. The process provides opportunity for each person 
In'the small groups to give Input, yet Is structured around bVocks of ti«e^Lo_ 
whTciTspectfTC tasks are performed. 

Reverse-flow conferencing . Traditionally, parents have Interviews with 
teachers or counselors In order to get Information on their child's progress. 
They expect that evaluation will be done by the school, and that they will re- 
ceive suggestions for Improved worl< or recognition of the child's achievements. 
The flow of Information Is thus primarily from the professional to the" 
parent. 

In reverse-flow conferencing; the flow of information Is from the parent to 
the teacher/counselor. Parents give their views of their child's feelings and 
achievements and the teacher offers only clarifying questions or expressions of 
Interest. Information must be withheld, as well as expressions of attitudes 
that would normally be expressed (Blood and others 1969) • 

Reverse-flow conferencing can be used In conjunction with parent ratings of 
student needs, either during or immediately after the ronference. 

COMMUNICATION CHANGES IN EDUCATIONAL SYSTEMS 

Certain changes In Internal and external communication patterns In public 
education have occurred In the past decade, partly as a result of the demand for 
broad-based needs assessment and accountability. 

Traditionally, comnunlcatlpn In the public schools has been top-down, inside 
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to-outslde, and one-way. That Is, cofntnunlcatlon was thought of mainly as a way 
of disseminating Information to people who needed It— policies, currlcular plans, 
and the like, internally, commurilcatlon tended to be from the board and adminis- 
tration down to teachers, thence to students. Externally, it was from the school 
system to the public. This Is typical of "closed" systems. [ 

sscssment has tended to ''open up'* the system. What has happened to 
internal communication as a result? For one thing, students and teachers have a 
cf^aincc to say what they think the goals of education should be and how well they 
are being attained. In othef^words, there Is now upward communication In the 
systemT-from students.^, teachers, support staff, and others to the administration 
and board; 

And what about external communication? Now the schbdWs hearing from many 
different Segments of the community, parents as well as others. And this conv-. 
munlcatlon Is being actively sought* 

Thus the paUerns and flow of comiminlcatlon appear to be changing— slowly 
In many places, but quite rapidly elsewhere. Communication Is seen as a way of 
promoting dialogue. Interaction, participation, and Invol vement~not just ^'telling.'* 

" Even when the communication Is one-way, as In written surveys, the schools 
are getting new Information and Involving new people. 

Another way of looking at communication In the needs assessment process Is 
to ask: What messages are" sent? Who sends them? What processes are used? Who 
receives them? What are the ''outputs*' of these messages? 

You might design your own communication strategies for needs assessment by 
selecting the most appropriate messages and sources , choosln^^teractlve and/or 
non- interactive channels , and specifying the resulting messages an d receivers. 

Figure 19 summarizes alternatives In these communication links, and relates them 

« 

• to the Input-process-output flow of a system. Other Items could be added to each 

±^± 

of the columns. 
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Insert Figure 19 



COMMUNICATION RISKS 

The "new look" in communication— large-scale community participation In 
ne^ds assessment— Is also related to the recent trend toward "participative 
managenwnt" In education. But there are risks In suddenly changing the communi- 
cation patt<irns. " ^ 

If communication has previously been closed, with little or no Input to top 
administration from teachers, students, or the community, a change may be viewed 
with susptclon. People want to know, what's the hidden agenda? 

Too much communication |s as bad as too ll,ttlc. People may have an "Infor- 
mation overload." Or the needs assessment may raise some sensitive Issues, and 
It Is necessary to be sure that clear, unambiguous messages are gefting ogt. 

Attempts to, Involve the school and parents In assessing heeds have sometimes 
resulted In considerable resistance and worsened communication. In a three-year 
study of a school district In Ohio ( A Profile of Change 1973), a needs assessment 
performed by Battelle's Center for Improved Education at district request, and the 
programs to Increase participation in planning which resulted from It, were strongly 
resisted for many reasons. In the third year, all groups but students felt the 
coimnunlcatlon problems had actually become worse! 

Blanchard and Hersey (1973) warn us not to implement a change or introduce 
participation without incorporating the appropriate communication strategy. It 
Is ^Iso Important to know what is the present communication structure. A system 
previously run on coercive principles will find faculty more dependent on admin- 
istration leadership and less ready for an open system. Reports from case studies 
revealed that some parents and teachers thought the needs assessment was an attempt 
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to Impose a point of view rather than an honest request for Information and opin- 
ions. 

In regions with minority ethnic populations, It Is particularly necessary to 
be sure that . the cofrwunlcatlon processes used allow all to participate In the S 
way In which they feel most comfortable. For a discussion of cross-cultural com- 
munication » see Chapter 13* 

Kaplan gives an Insight Into an unanticipated problem In connection with 

participatory gbaj setting statewide In New Jersey: 

This decision carried with ft some consequences that were not en- 
tirely unforeseen. EducatloTial groups, Including teachers, ad- 
ministrators, and school boird inembers took Issue with this approach 
(placing major emphasis on the publlc^s Input and the limitation on 
the educational contingent). Hany regarded the project as a thinly 
disguised effort to diminish their Influence In educational affairs. 
They were also suspicious over whether the Department of Education 
did not have an ulterior purpose and that It was perhaps concealing 
an already developed master plan for Introduction at a later date 
on an unsuspecting public and a reluctant profession. 

(Kaplan 1972, 8) 

\. • 

Advantages of high Involvement and Interaction . In spite of potential risks, 
the process of Interaction, In Itself, may be the most Important and rewarding 
feature of the needs assessment. Reports from Implementation of the PDK, Fresno, 
and Worldwide models, which rely heavily on this feature. Indicate that the 

enthusiasm and commitment of participants, both to the assessment and to later 

f 

implementation of the priorities, are factors of major importance* ^'Regardless ' ^ 
of the data, It was the process that mattered,** report many project inanagers. 

High Involvement lets the public know t,hat the schools care about what they 
think, particularly If there Is some assuraiSte that the needs assessment will re- 
sult in Improved Instruction and/or services. 

Disadvantages of high involvement . The disadvantages may lie not so much In 
the fact of involvement per se, as In the nature of the data collected. Models 
In which the Invblvcment, focuses on producing lists of concerns or rankings of 
goal statements may appear to have generated more informatics about real needs 
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than Js in'Jact the.case.. When the major or sole emphasis Is on such Involvement, 
It may obscure the fact that the decision makers have very little real data about 
dis|^epancles in goal attainment. . . 

Other factors which may lessen the value of Involvement are Inept facill- 
tatlonlof groups, inadequate or nonrepresentatlve 'sampling, breal<downs In com- 
munication during high interaction sessions. Imposition o,f the opinions of a .few 
authority figures on the majority, and misunderstanding by the participants 
regarding the nature of the task at hand. 

Some methods of counterbalancing such factors are careful. training of facili- 
tators or group leader? In the task and in communication and group process skills, 
the use of delphl technique for achieving consensus, and orientation of particl-- 
pants to the nature of the needs assessment and the uses that wll 1 be made of the^ 

f 

results. ' . * 
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STRENGTHS AND LIMITAT.IONS OF ALTERNATIVE MODELS/APPROACHES 

As far as can be determined, there have been no comparative studies pf the 
.benefits derived from various models. Furthermore, many of the studies on sys- 
^tematlc needs assessment have taken place In the last two to three years, so 
that the long-term results have not been determined. 

Strengths and limitations come from two sources- the model or procedure 
Itself, and the way In which it Is applied in a given case. 

The oolnts raised in this chapter came from applying the ''criteria for a 
good model*' (Chapter 3), and from Interviews with people who have Implemented 
the models referred to. 

GENERAL SYSTEM MODELS 

Some examples in this category are the Dallas, EPIC, Kaufman's, Educational 

Systems Associates, and Worldwide models. 

Strengths of this approach are that needs assessment Is placed specifically 
within the framework of systematic planninlg, not something added on. The assess 
mcnt i.s organically related to all other planning and decision-making processes. 
It Is adaptable for any size educational agency or region, and the procedures 
can be tailored for a given system. 

Limitations are that the assessment generally requires an expert management 
team, considerable commitment of people's time and other resources, an^a period 
of several months or a year to do an adequate' job. People may become tired of 
the process. If care is not taken, the assessment Itself will become more Im- 
portant than the decisions that are to be made as a result. For best results, 
consultant services may be needed. Some users have seen the process as too open 
ended and unstructured. 
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In inost of the general models, no prepackaged Instruments are pro.vlded; 
Costs may thus be higher than for "off-the-shelf" Instruments. Development of 
prpcedurefe locally can be both a strength and a weakness. 



evaluation J 
model leaves 
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INDUCTIVE '^APPROACH 

• The Dallas and Fresno models and the Critical Incident technique are exam- 
ples of what Kaufman labels the Ihductive approach. Various data and/or behav- 
tors on "w4at is" are collected and analyzed before goals are developed. 

Strengths of both these models are the high degree of community and school 
involvement jand moderate costs. When the models are fully implemented, they use 
lata from the previous year as input to present needs. The Fresno 
open the question of what areas or conditions are to be considered. 
The Dallas mLdel , however, does have d framework for ranking priority areas, al- 
though these ^re not goals as such. 

Limitations are that both models need competent, trained management or leader- 
ship; The Fi-esno model has' inadequate guidelines for avoiding confusion between 
goals, concerns, needs, and solutions, and does not provide a discrepancy analysis, 
The Dallas model involves large numbers of people -irking for several months, and 
staff must be given release time for monthly meetings. . 

-aEOUCTIVE APPROACH 

In this approach, goals are selected (and usually rated for importance) be- 

fore data and/or behaviors are collected. The materials may be prepackaged or 

/ 

developed locally. 

. ^ Strengths of the deductive approach are that the goals provide a structure 
for looking at "what is" In the schools. If both 'immediate and future goals are 
used, the needs assessment w 1 U give fresh insight on possibilities for renewal 
and Innovation. When goal statements are-.properly phrased, there is no confusion 
between ^oals and solutions. ^ l^vB 
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Limitations are that goals may be too general to give an adequate structure 
for examining "what Is." The goal structure may be too limiting or. If long lists 
are used, too unwieldy to base the assessment of present status. 

Other strengths and limitations will be considered In the next section. 

PREPACKAGED INSTRUMENTS AND KITS 

These are usually deductive. Examples of prepackaged surveys are the Bucks 
County, Battel l2, IGl, SRC, and Westlnghouse. Examples of kits and packets are 

_ i 

ACNAM, CSE, and PDK. » . j 

Strengths of these materials are that they give a prm structure ajnd guidance 
to the entire effort, In most cases, although that effort may In some cases be 

/ 

limited to the survey procedure Itself. Generally/ outside consultants are not 
needed for management, although they may be prov/ded (Battel le, Westlnghouse, IGl).- 
Single surveys are easy to administer ^nd take a relatively short time* Data 
processing services are available for some. Costs may be less than the general 
system models because Instruments do not have to be developed locally. Most give 
guidelines for samp 1 lng[^, from the client populations. The CSE differentiated 
school norms and decision model are strong points. 

Limitations are that the model may not fit local conditions, although most 
of the surveys have provision for adding goals or other questions. CSE, Bucks 
County, and ACNAM provide for using and Integrating objective data with subjec- 
tive ratlngs-the others do not. Battelle's surveys mix learner and Institutional 
goal'areas. The 106 goals In the CSE Kit may be overwhelming to work with, and 
the ACNAM surveys appear to be too long. Neither ACNAM nor Bucks County has 
•a clear-cut method for establishing priorities among goals. 

Only the PDK me'thod uses Interaction and face-to-face Involvement. The others 
Identify community concerns only through written survey or goal-ranking Instru- 
ments. 1Lf-^*7 
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PRO'S AND CON*S ON PROCEDURES 

Whether you use a prepackaged set of materials or design your own, you will 
find that there are many ways of setting and rating goals, determining "what Is" 
/tn relation to those goals, and setting priorities. Table 2 displays some of 
I the advantages and disadvantages of alternative methods. 



Insert Table 2 



Additional points to consider, not shown In the table, are these: 
Goal setting . Few groups realty take a fresh approach to goal setting, ex- 
cept those that use futureng methods. People look at other people's lists, or 
derive goals from the existing curriculum. Thus there Is little possibility 
for renewal . ^ , 

On the face of it, the active involvement of many citizens In goal setting 
seems like a good thing to do. But sometimes there are problems. 

The advisory council for the statewide needs assessment In New Jersey found: 

Goal determination Is far from the matter-of-fact, simpi Istlc 
activity that most observers tend to view It. Goals are fre- 
quently and quickly confused with secondary objectives, public' 
issues, methodology, and with the amelioration of deficiencies 
is our society as a whole. They are closely aligned with values, 
philosophy and the democratic Ideal, all contributing to the 
complexity of the task. Furthermore, discission and decision 
making about goals Is a much more dlfflcultyfeat than Is gen- 
erally realized. There Is a pervasive' assumption that we all 
have common goals, that we all tend to work toward common ends, 
and that opening them to the light of public discussion will 
quickly reaffirm this. This l-S not so readily the case, however. 
For discussion entails conscientious and critical re-examl nation 
of tenets adopted long ago and usually by someone else. Serious 
consideration Is a much more demanding, complex, and time-con- 
suming exercise because It forces recognition of the full scope 
and enormity of the endeavor and the many competing forces and 
alternat ives. 

(A Summary of the ''Our Schools" Project 1970, 30) 
Goal rating . Rating or ranking goals by specific grade levels Is more pro- 
ductive than making global judgments about them for a school or whole system. 

ICS 
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Differences among client groups on ratings of Importance should be Investigated 
and reconciled, not just averaged. Causes for Interjgroup differences should be 
investigated, but most models do not suggest this. 

Perception ratings . Perceptions on goal |ttalrtment or i)resent status are 
often highly Inaccurate if used alone. Ritter (1966) did a study Jn which he 
gave parents factual statements about the school on which to base their judgments 
of goal attainment. Their ratings <Mffered marlcedly before and after they re- 
ceived this Information, 

Test scores . Test scores may not be as valid a source of Information on y 
••what is'* as Is often assumed. Stake (1973) points oi^ that school Inef fectlvej/ 
ness may be Ignored when attention Is drawn to student performance, and that /the 
irreducible errors of test scores should be recognized. 

Rating quantitative and qualitative data . Although most models offer some 
method of quantifying the discrepancies between "what Is" and "what should be," 
the data for "what Is" are usually derived from scales of subjective judgments. 
The resulting figures will be no better than the nature of the questions asked, 
the types of 'scales used, and the referents available to the respondents for basing 

/ 

their judgments. ' ' 

A technique such as Magnitude Estimation Scaling increases the precision of 
quantifying subjective data, as do critical ity indices which functionally relate 
two judgments such as importance and perceived attainment. Further refinement 
can be obtained by relating test scores to perceived goal attainment, and by 
adding factors of utility and probability of change to arrive at priorities for 
action. 

CONFUSIONS ENCOUNTERED 

Examination of the written reports from many needs assessment studies, using 
different models, reveals that widespread confusion exists regarding what Is a 
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"need.** In many Instances, needs are equated with goals which rank high in im- 
portance. In others, lists of needs include statements of symptoms of a problem, 
vague concerns, solutions, causes, and proposals for action. 

The confounding of symptoms, causes, and solutions is most likely to occur 
in the open-ended, n^n-goal -based models. The problem becomes acute when commit- 
tees must grapple with such lists when translating concerns into objeC|tives and 
plans for action. ^ 

Some confusion could be prevented by furnishing model users with guidelines 
differentiating such statements, and instructions for orienting participants, 
For example, the^e are linguistic cues, within the structure of statements, which 
differentiate between symptoms and solutions. Probing for reasons behind the \ 

\ 

statements, eliciting specific exanqsles, and checking out vague generalities, will 
usually clarify such lists so that they can be reorganized more meaningfully. \ 

Another type of confusion cc^nmonly found Is that between learner-centered 
and institutional-centered needs. The »»classic'* models firmly state that needs 
assessment must focus only on learner needs. This position appears to be modified 
Jn recent developments. Nevertheless, for decision making, the two types of needs 
should be carefully differentiated in the data collection and analysis. 

SUMMARY ^ • 

There appears to be an inverse ratio between the sophistication and complete- 
ness of a model and its widespread and enthusiastic acceptance and imptementatlon. 
Applying the criteria of a good model (Chapter 3) would result in high ratings for 
many which, in practice, are not very widely accepted or are. not implemented as 
designed. 

This chapter has set forth some broad strengths and limitations of many 
approaches. You as a user are in the best position to determine the feasibility 
aird acceptability of a given model or procedure within your system. 



CHAPTER 13 
SOCIAL FAIRNESS AND SOCIAL BIAS 

One aspect of needs assessment ts conspicuous by Its absence In the Uter- 
ature~the Issue of social fairness or social bias. There is almost nothing 
either in the research studies or In the models or kits which takes this matter 
into account* 

Social fairness Implies these considerations: 

I. Availability of foreign language translations of needs asssessment 
materials* 

, 2. Use of the most appropriate methods of interaction and Involve- 
ment for people of minority cultures. 

3. Concern for' adequate representation of all cultural and ethnic 
groups In the needs assessmervt process. 

Appropriateness of the educational goals and the focus of the 
assessment to the rmjl ticultural world of the future. 

5. Adequacy of existing performance tests and other measures of 
»»what Is.** . 

There Is little evidence that any given method of assessment has built-in 
biases against minority cultures. But the very lack of discussion of such matters 
In the materials on needs assessment Is a cause for concern. Let us examine each 
of these points. 

1 . Translations 

Few of the kits examined offer materials translated Into other languages. 
ACNAM has a Spanish- language version of the parent survey, and Phi Delta Kappa . 
offers lists of goals and rating sheets In English and Spanish. 

This is just a beginning, however. If students and parents from non-English 
language backgrounds are to be adequately Involved, materials should be available 

ici 
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in the language they know best. 

There are problems In getting adequate translations, of course. One is that 
translators differ among themselves on the correct or most adequate representation 
of an Idea. An even more Important problem Is that much educational jargon does 
not translate easily. How do you translate "criterion-referenced tests" to Span- 
ish? As a matter of fact, many terms common to educators make no sense to the 
English-s1)eaking lay public. Trying to translate goal statements or survey In- 
struments into another language Is a healthy exercise in clarifying the English 
version! 

2. Method s of Interaction 

Almost no research has been done on the best methods of involving people of 
different cultures in the needs assessment process. We assume that all aduits 
should be able to answer a written survey, or participate in a community speak- 
up or grou^ discussion. Not so* \ 

An interesting study was undertaken at ^,the Center for Northern Educational 

Researfch^^at the University of Alaska. The problem they were asked to solve was 

that most of the children attending the schools in Alaska were native Alwskans, 

but most of the teachers and administrators were white. Some method had to be 

developed to promote more open communication between the two populations. 

it was the Intent of the project to establish needs assessment 
as the first step in breaking the pattern of inter-ethnIc non- 
cotmiunicatlon which was instilled in all Alaskan public educa- 
tional systems. A method was developed which openly solicited 
contact and communication between the educational establishment, 
usually dominated by personnel and value orientations of the 
vy»hlte American majority, and Native parents, whose voices are 
rarely heard by the institution but who are the so-called re- 
cipients of services of the total educational establishment. 
The project's community participation approach to needs assess- 
ment differed from the educational needs assessments previously 
exercised In that it attempted to build working relationships 
between school people and community people as needs were iden- 
tified, rather than simply gathering data and turning them over 
to policy-makers or record keepers. (Moore and Senegut 1973. D 
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^ The Center set up six regional workshops, using various methods of Involve- 
ment with small groups, large groups, shared meals, films, and role playing. The 
core staff included a well-known Eskimo artist and writer, a Tlingit Indian 
teacher with a master's degree In school administration from the University of 
Alaska with Peace Corps teaching experience, and a-white teacher with a master's 
degree in elementary teaching. 

The staff considered the factors of appropriate physical surroundings in the 
meeting areas, how to group people, degree to which the agenda was structured, and 

the direction taken by speakers and consultants. 

They also paid considerable attention to how groups were arranged, status 

factors, and nonverbal communication such as eye contact, gestures, and movement. 
These factors vary fi^^^t^y among different cultural groups, although we tend to 

take for granted that "our^^y is the only way. 

For example, Native peopleT^rKthe presence of white people, will begin by 

keeping quiet; white people begin by tal^^ Native people will speak more 

quietly. White people will do most of the taliH^j^even when they are in a minor- 

\ 

Many whites think the Native people are "nonverbal." Tije authors point out 
that keeping quiet in a threatening situation is a cultural response not limited 
to Alaskan Natives, just as talking in a threatening situation is a cuHural re- 

sponse. \ 
The Center staff concluded that the fostering of communication channels was 
"difficult, painful, arduous, and frustrating" for the staff members, consultants, 
and participants, but that it was necessary. 

Whether the minority group is Asian-American, Native-American,^ Mexican-Ameri- 
can, black» or "white ethnic," it cannot be assumed that one style of communicatio 
wilt be meaningful for all. 

Where questions of adequate cross-cwl tural communication arise, a source of 
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Information would be staff at the nearest university who are engaged in cross-' 
cultural communication research. They would be found typically In departments 
of speech communication, sociology, or anthropology. " Representatives of the 
minority groups concerned should, of course, be on the needs assessment planning 
committee. 

3. Representation 

Problems arising from socia! bias or inadequate cross-cultural communication 
can'often be prevented or dealt with by appropriate representation on the needs 
assessment steering or planning canmittee. Parents, students, interested citi- 
zens, and educators from minority groups can be asked to participate. They can 
give valuable advice not only on language and the more obvious cultural barriers, 
but on appropriate methods of Involvement and ways to ensure active participation 
of all those with a stake in the educational prbcess, throughout the needs assess- 
ment stages and later in in^lementing the recommendations. 

Racial and cultural minorities are not the only groups inadequately repre- 
sented. It has been found that social agencies (including schools) rarely listen 
to the poor, who are perceived as having low credibility. 

When san^Hng Is used In large-scale surveys or polls, care should be taken 
that the sampling technique ensures representation of all groups in the community 
having a stake In the needs assessment. 

1». Appropriateness of goals 

If you use a model which has preprinted lists of goals, they should be exam- 
ined for appropriateness to all social and economic groups In the community and 
student body. Parents and students from all groups. Including minorities, should 
have an oppo'rt^lty to say what they really think about the goals, particularly 
since they may ernb6<y differing cultural values. Rating sheets alone may be In- 
.adequate for responses.^ They could be supplemented with interviews, small group 
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discussions, or written comments* 

5. Social bias in tests 

It Is well known that many achievement tests do not take important cultural 
and linguistic differences into account. As a result, children from minority 
cultures may be unfairly judged on the basis of tests which! have norms based on 
groups quite different from theirs. The real needs of pupils may thus be ob- 
scured by the biases in the tests themselves. 

Recently some instruments have been published which assess the dominant 
language of children, and also show their level of language development in 
the dominant language. But few achievement tests have forms which haye been 
normed on other than middle-class white students. The CSE Kit gives guidelines, 
however, for adjusting such norms to schools with different ethnic, socloecomonic, 
and language backgrounds. 

ASSESSING SOCIAL BIAS 

The Issue of social bias can Itself be a subject for needs assessment. 
Questions concerning attitudes of students and staff toward cultural differences 
and toward working with people of other ethnic backgrounds, for example, could 
be Incorporated In survyes. The multicultural education Instruments described In 
Chapter 6 are a start In that dl rectlon. The ACNAM, also, has extensive sections 
on bilingual and multicultural education In Its surveys. 
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AN AFTERWORD 



Now that you have comRleted the needs assessment, what will you do with the 
results? And will they make any d4fference to your educational program? 

Needs assessment techniques are still in the formative stages. We have 
very little information on the impact of assessments on education, which approaches 
are most useful, and how the results are being, or should be used. 

Here are some assumptions that should be tested: 

--That we know what the desired conditions **should be." 

--That we can really find out "what Is." 

—That needs can be defined as simple discrepancies between "what is" 
and "what ought to be." 

—That we know how standards should be set for the schools, and who 
should set them. 

Kaufman makes a number of points which deserve attention in summing up major 
concerns of needs assessment. 

1. A needs assessment Is never completed. It must be a continuing affair, 
and changes In needs are to be expected. 

2. A discrepancy analysis Is the documentation of a measurable difference 
between current and desired (or required) states of affairs. It Is 
not enough to guess el^h^r wher^ we are or where we should be--*Sye 
require hard empirical data for both polar positions of a need." 

3. A need is net a solution. Preconceived solutions must be left out 
of statements of discrepancies, of; they bias the outcome and re- 
strict the use of Innovative ot creative ways to solve a problem* 

4. In setting priorltleson need areas, they might be judged by two 
criteria: (a) what does It cost to meet the need, and (b) what does 
It cost to Ignore the need? 

5. Be sure all partners to the educational endeavor are involved In 
selection of needs and decisions about them. 

6. Never select Instruments that place blame on any group, or that 
could benjsed to do so. , 

7. Reconcile discrepancies among viewpoints of different groups. ^ 
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8. Outcomes for the future as well as for the present should be In- 
cluded, since "we should not attempt to capture the status quo 
and, derive an education system to maintain that status." 

(Kaufman 1972, Chapter 3) 
Finally, It should be recognized that needs assessment is only a beginning— 

the planning and Implementation of solutions Is yet to come. In many districts, 

also, the setting of goals has become an end In Itself. 

The word from the project managers is, don't put all your school and community 

energy "eggs" In the needs assessment "basket." Leave something over for turning 

those high priority n^eds Into Improved educational programs and services for all 

concerned. 
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FIGURE 3 

GENERIC STRATEGIES FOR ASSESSING EDUCATIONAL NEEDS AND 

IDENTIFYING GOALS 



Identify Extant Behaviors (*) 

^Compi 1e and Classify 
Behaviors Into Programs 
and Behavior Expectancies 

Compare to Existing Broad 
Goals 

T 

Reconcile Discrepancies (*) 

Set Detailed Objectives (**) 
I 

Develop Educational 
Program (**) 

4 I 
Implement Educational 
Program 

Evaluate Educational 
Outcomes (*) 
t 

Revise 



Type D 

Identify and Select 
Extant Goals of 
Education 

I 

Develop Criterion 
Measures 

I ~ 

Obtain Change 
Requirements (*) 

I 

Collect Performance 
Data and Determine 
Discrepancies (**) 

Set Detailed Objectives (**) 
I 

Develop Educational 
Program 

Implement Educational 
Program (^*) 

I 

Evaluate Educational 
Outcomes (*) 
T 

Revise (**) 



Type C 

Generic Goals (**) 

Develop Programs 

Implement Educational 
Program 

Evaluate 



(*) Accomplished by educators and representatives of 

sub-community members served by the agency 
(**) Accomplished primarily by educators 
(***) Primarily accomplished unsystematfcal ly 



Three different models for determining educational needs. Type I Is basically 
Inductive, type D Is basically deductive, and type C Is intended to be repre- 
sentative of '^classical** educational procedures for identifying and defining - 



goals and objectives.. After Kaufman and Harsh (1969). 



-.O Roger A. Kaufman, Educational System Planning , 
tlvC Prentice-Hall, Inc:, Englewood Cliffs, New Jer 



© 
sey. 

1^5 



972. By permission of 



FIGURE i» 

COMPLETED CRITICAUITY FUNCTION DISPLAYING THE 
LEVEL OF PROGRAM NEED FOR THE SCHOOL STAFF 
RESPONDENT GROUP 



5 ^ 
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Low Level 
Successful Program 
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• 23 



L 

Low Level Need 



Successful 
Program 



'16 



Overall Mean 
Goal Attainment 
(19) 



Critical Need 



School Staff Mean Goal Importance 



* X ' 



Hershkowitz 1972. For each specified goal statement the mean scores for goal 
importance (horizontal axis) and mean scores for goal attainment (vertical axis) 
are plotted as a point. The numbers 1, l6, 23, and 37 refer to goal statements. 
The axes and ? Indicate '^critical Ity axes.*' After plotting the goal points 
and deriving the axes, the quadrants are assigned a level of program need. ThMS, 
the goal associated with goal point 16 Is considered to have a ^'Critical Need'* 
O fhlle the goal associated with goal point 1 Is considered to be a ''Successful 
rogram,'^ The process Is repeated for each respondent group. 



FIGURE 5 



PUBLICS' RATINGS OF NEW JERSEY GOALS 
ON IMPORTANCE AND ATTAINMENT 
lOO-i- 
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ERJC Mnlon Research Corporation 1972 
™"^^prlntacl by permission. 
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FIGURE n 

MAGNITUDE ESTIMATION SCALING: SCIENCE OBJECTIVE EVALUATION SCORES 
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FIGURE 12 



PAIRED-WEIGHTING PROCEDURE FORM 
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FIGURE 13 



FLORIDA COMMUNITY COLLEGE MODEL 
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FIGURE 14 



DATA BASE FOR COMMUNITY COLLEGE MODEL 
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FIGURE 16 

SAMPLE MODEL FOR THE ASSESSMENT OF AFFECTIVE NEEDS 
AT THE LtARNER-ORIENTED LEVEL 
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FIGURE 171 

MODEL FOR ASSESSMENT OF AFFECTIVE NEEDS AT 
THE FACILITATIVE-SUPPORTIVE LEVEL 
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F.IGURE 18 

COMMUNICATION METHODS IN RELATION TO 
HUMBERTS INVOLVED AND AMOUNT OF INTERACTION 
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APPENDIX A 



^MODELS AND GENERAL INSTRUMENTS 



The inclusion of any model or Instrument In this 
Appendix does not constitute an endoresement of 
said model or Instrument by the author of this 
study or by the National Institute of Education. 



ALAMEDA COUNTY NEEDS ASSESSMENT MODEL (ACNAM) 



Publ Isher : 

Phone: 

Date: 

Contents: 



Cost: 

Contact Person: 



Office of the Alameda County Superintendent of Schools 
685 A Street 

Hayward, California 9^5^1 

{k]S) 881-6281 

197^ 

User's Manual, Teacher Survey, Staff Development Survey, 
Parent Survey (English and Spanish versions), Pupil Survey 
(readers' and nonreaders' [p.Uture] versions). Statistical 
Summary and Data Forms, Compilation of Survey Questions. 
for elementary level. / 
$5.00 for complete sample l^'it. 

Dr. Belle Ruth Wltkin, Coordinator, Research S Evaluation 



BATTELLE'S SURVEYS 



I 



Publ isher; 

Phone: 
Date: 
Contents : 



Cost: 

Contact Person: 



ERLC 



Battel le's Center for Improved Education 
505 King Avenue 
Columbus, Ohio ^3201 

{(>]k) 299-3151 

1972 and 1973 

A Survey of Educational Needs . 

Secondary School : Questionnaires for administrators, 
teachers, students,' parents, and community members. 
Community College : Questionnaires for board of trustees, 
studentsr administrators, faculty, and sul^portive statf. 

Fixed price basis to the district or college. 

David L. Hamilton, Program Director 
Management Systems 

ICS 



APPENDIX A - continued 



BUCKS COUNTY QUALITY PROGRAM EDUCATION STUDY 



Publ isher: 



Date: 
Contents 

Cost: 

Contact Person; 



Office of the Bucks County Superintendent of Schools 
Intermediate Unit #22 

Division of Curriculum and Instruction Services 
Ansley Building - Old Easton Road, R.D. ffk 
Doylestown, Pennsylvania 13901 

June 1971 

12 Booklets: General Needs Assessment Instrument 
for the 10 Goals^of Pennsylvania, 10 specific instru 
ments for pupil self-assessment. 

$10.00 for one set 

Dr. Raymond Bernabei 



CSE ELEMENTARY SCHOOL EVALUATION KIT: NEEDS ASSESSMENT 



peveToper : 
Publisher: 

Date: 
Contents ; 



Cost: 



Authors: 



Center for the Study of Evaluation, University of 
California at Los Angeles. 



Al lynr and Bacon, Inc. 
A70 Atlantic Avenue 
Boston, Massachusetts 



Longwood Divis ion 

02210 
1972 

Guidebook. Boxed Kit of Materials: Principal's 
Goal Rating Formes (12); teachers' and parents' 
card-sort goal assessment set (10 decks of IO6 
goal cards each, 10 sets of 5 rating mats, 50 
rating forms); parents* goal rating question- 
naire (AS). 

Kit, $1^7.50. Reorders: Principals* Goal 
Rating Forms (12) $6.95. 

Teachers' and parents' card sort, $6.95 (10 
decks of 106 goal cards, ID sets of 5 rating 
mats.) 

Teachers' and parents' rating forms. (50), $6.95. 

Parents' goal rating questionnaire (AS), $8.95. 

Ralph Hoepfner, Paul A. Bradley, Stephen P. Klein, 
Marvin C. Alkin - (CSE/UCLA) 

1C3 
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APPENDIX A - continued 



DALLAS MODEL 



Publ Isher: 

\ 

Phonfe: 

Date: 

Contents: 

Contact Person: 



Dallas Independent School District 
3700 Ross Avenue 
Dallas, Tex?-^ 7520^ 

(214) 824-75204 
1973-74 

1. 1973-74 Needs Assessment Survey 

2, Sharing Decisions—Dallas Style. 
An Overview of Dallas' Model for 
Shared Decision Making. 

Dr. Larry Ascough, Assistant Superintendent, 
Communications and Community Relations Department 



ESA NEEDS AS^ESShiENT PROCEDURE MANUAL' 



Publ Isher: 

Phone: 

Date: 

Contents: 

Cost: 

Contact* Person: 



Educational Systems Associates 
300 East Huntland Drive 
Austin, Texas 78752 

(512) 454-8721 

1974 . " ' 

Loose-leaf manual describing procedures to be 
considered in planning a comprehensive ne^tfis 
assessment study. 

$7.55 

Bruce Read, President 



EPIC MODEL 



ERIC 



Publ Isher : 

Phone: 
Date: ' 
Contents: 

Contact Person: 



Education Innovators Press 
P. 0. Box 13052 
Tuscon, Arizona 85711 

(602) 795-4210 
1972 

Needs Assessment, Booklet #8. Outlines steps for 
conducting needs assessment and subsequent evaluation 
of changes implemented to eliminate identified needs. 



Wayne Roberson, President 

1C4 



APPENDIX A - continued 



FLORIDA COMMUNITY COLLEGE MODEL 



Publlshe*": . Tenter for Community College Needs Assessment 
1212 S, W. Fifth Street, #8 
Gainesville, Florida }2oC\ 

Phone: (904) 392-07^5 

Date:' 197^ 

Contents: Computerized program for model. Surveys and 

instruments employer needs, goal setting, 
evaluating courses, student characteristics, 
follow-up of students, community perceptions, 
and management analysis. 

Contact Person: Dr. Katie D. Tucl<er, Project Director 



FRESNO MODEL 



Publ isher : 

Phone: 
Da* j: 
Contents: 

Contact Person; 



Office of the Fresno County Superintendent of Schools 
2314 Mariposa Street 
Fresno, California 93721 

(209) 488-3337 

July 1973 (Second Edition) 

Booklet: The School and Community - Partners 
in Education . Description and flowcharts for. 
community conference and development of needs 
and goals. Fi Imstr ip/cassette orientation. 

Dr. Wayne N. Jordan 



RJC 



Institutional goals inventory (igi) 

Publisher: Educational Testing Service, College and University Prog 

Princeton, New Jersey OSS'^O 

Date: )37^ 

Contents: Specimen set Includes IGI Booklet/Answer Sheet, 

Instructions, Profile Chart, Order Form, and 
several reports and position papers. 

Cost: Booklets, 35* each; scoring and reporting service, . 

$1.25 per booklet; $200 minimum charge for scoring 
booklets ir one report. IGI specimen set, $3-00. 

1C5 
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APPENDIX A -' continued 



PHI DELTA KAPPA MODEL 



Developer : 

* 

Drstributor: 



Phone: 
Contents; 



Cost! 



Northern California Program Development Center 
California State University 
Chico, California 95926 

Phi Delta Kappa, Inc. 

Commission on Educational Planning, 

P. 0. Box 789^ 

Bloomington, Indiana 47^01 

(916) 895-5328, (Chico State University) 

Workshop packet contains: Administrator's 
Manual; goal cards, display board, and discs 
for group rating of goals; rating sheets 
^ (English and Spanish); programmed course 
'for writing performance objectives, and 
manual for irse. 



Contact Persons 



Program for' 60 persons 

Ref 11 Is for disposable 
items in the program 

Workshop packet 

Dr. B. Keith Rose, NCPDC 



• $70.00 

28.00 
3-00 

«Dr. Wfjlmer Bugher, Phi Delta Kippa 



PUPIL-PERCEIVED NEEDS ASSESSMENT PACKAGE 



Publ isher : 

Phone: 
Date: 
Contents : 



Cost: 

Contact Person: 



Research for Better Schools, Inc. 

1700 Market Street 

Philadelphia, Pennsylvania 19103 

(215) 561-^100 

October 197^ 

Boxed kit of . 5 booklets and cassette tape: 
planning a PPNA Project, developing and 
administering the PPNA indicator , process- 
ing and analyzing the data, sampling. 

$25.00 

Dr. Hsuan L. DeLorme, senior author 
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APPENDIX A - continued 



WESTINGHOUSE SURVEY 



Publ ishen 

Date: 
Contents: 

Cost: 



Westinghouse Learning CorpQration 

P. 0. Box 30 

Iowa City, Iowa 52240 

April 1973 

Administrative Hanual 

Assessment instrument suitable for community, 
educators, and jsecondary school studentsi^ 

$300 set-up; off-the-shelf booklets with 50 
goal statements, 18< per booklet; scoring 
and processing, 50< per jaooklet scored; 
customizing, 25* per booklet additional. 
Costs include four copies of all reports, 



WORLDWIDE MODEL 
Publ isher: 

Phone: 

Date: 

Contents: 

Cost: 



Worldwide Education and Research Institute 
2315 Stringham Avenue ^ 
Salt Lake City, Utah 84109 

(801) 521-9393 

1974, Revised Edition 

Needs Assessment Source Book 

10 manuals, keyed to master flowchart 

Fi Imstrip/cassette orientation* 

Source Book $10.00 

Manuals — 3.00 each 

Filmstrip — 20.00 
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APPENDIX B 



SPECIALIZED INSTRUMENTS 



Assessing Career Needs of Learners. Grade 8 
Publ isher : 



^Date: 
Contents : 



Northwest Regional Educational Laboratory 
710 W. W. Second Avenue 
Portland, Oregon 9720^ 

197^ 

Student self-assessment on careers/ school attUudes, 
and perceptions of own knowledge and skills. 



Evaluation Guidelines for Multiaultural/I4ultiraaial Education 



Publ isher: 

Date: 
Contents: 

Funny Faces Game 
Pub J Isher : 



^ate: 
Contents 



National Study of School Evaluation 

2201 Wilson Blvd. 

Arl ington, Virginia 22201 

1973 ' 

Two short opinionnaires, one for students and one 
for teachers. ^ 
Also guidelines and checklists for evaluating the 
school's multicultural program. 



Operations Research, Inc. 

UOO Spring Street 

Silver Spring, Maryland 20910 

1972 

Early childhood self-esteem inventory. For 
individual administration. 



Heeds Assessment Package for Pight to Head SchooUBased Centers 

Publisher: Right to Read Program 

U. S. Office of Education 

Contents: Instructions and forms for collecting and display- 

ing data on reading program from existing sources, 

Uorbar Attitude Assessment Survey 

Publisher: Northern California Program Development Center 

California State University, Chico 
Chico, California 95926 

Author: Jack L. Lutz 

Contents: A Manual for survey construction, survey adminis- 

tration, and data utilization. Item bank and in- 
Q st rumen ts included . 
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APPENDIX B - continued 



PRIME ^ (Program Research in Integrated Multiethnic Education) 

Publisher: University of California 

Riverside, California 92502 

Date: 1973 

Author: Dr. Jane R. Mercer, Principal Investigator 

Contents: Evaluating Integrated Elementary Education , 

Techn i ca 1 Manua 1 . Measuring Integrated ^ 
Education In Elementary Schools , Training 
Manual for Data Collection. Tncludes 
extensive research data on the Instruments. 

Priority Counseling Survey 

Publisher: Educators Assi^tarice_lnst_i tute 

9841 Airport Blvd. 
Los Angetes, California 900^5 

Date: 1972 

Authors: Thomas W. Smith, Clarence D. Johnson 

Contents: Questionnaires on career interests and counseling 

needs for Junior and senior high school students. 

Procedures for Surveying School Problems 

Publisher: Human Resources Research Organization 

300 North Washington Street 
Alexandria, Virginia 2231^ 

Date: 197^ 

Contents: Manual, containing School Demographic Information 

Font, Problem Area Survey For School Staff Members, 
and Problem Area Survey for Students. 

Student Opinion Inventory 

Publisher: National Study of School Evaluation 

2201 Wilson Boulevard 
Arl Ington, Virginia 22201 

Date: 197^ 

Contents: Survey of student opinion on the school *s Instructional 

program. Manual has instructions for administering, 
scoring, and Interpreting, and reliability and validity 
data. 
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APPENDIX B - continued 



Student Reactions to College (SRC) 

Publisher; Educational Testing Service 

Cbnrwnunity and Junior College Programs 
Box 2812 

Princeton, New Jersey 085^0 
Date: 1973 

Contents: Self-admtnistered questionnaire for reactions to 

experiences or situations In community or junior 
college. 

Costs: ^ Specimen set, $4.00. Booklets, 35^ each; scoring 

and reporting service, $1.25 per booklet; $350 
minimum charge. • ^ 

TARGET (To Assess Relevant Goals of Education Together) 

Publisher: Blaine \/ishart 

966 King George Way 

El Dorado Hills, California 95630 

Date: 1972 

Contents: Manual and materials for "Delphi" study and the 

TARGET game. Includes various indices for inter- 
pretation. 
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METHODOLOGY 

The purpose of this study was to analyze and interpret the state of the. art 
of needs assessment techniques for educational planning, and to provide visibility 
(1) to those current mode)^, procedures, and instruments which hold promise for 
^ facilitating such planning, and (2) to those which might impede or confound the 
planning. ThC;, report was directed to administrators dnd researchers with respon- 
Sibil Ity foif needs assessment, planning, or evaluation at state, intermediate, and 
district levels. * ^ 

The study was performed In three phases: input, analysis, and reporting. It 
extended from September 197^ to May 1976. 

mvm PHASE 

f 

Advisory committee . An advisory committee of 19 persons knowledgable about 
various phases of educational needs assessment was set up. All but two were from 
California, because of budgetary limitations. They were chosen to represent a 
cross-section of educational responsibilUy,: ethnicity, and geographic dispersion. 
A list of the committee is attached. 

The full Advisory Committee met three times— in September, October, and 
February. They established criteria for a good needs assessment model, reviewed 
Instruments that were available at the time, suggested certain analytic procedures 
and reviewed the first Hraft that v.as submitted to NIE. In addition, a small sub- 
committee met with me twice to work on the first draft and later to assist with 
reorganization of the report following the NIE and committee recommendations. 

Literature search . There were three major methods for obtaining studies and 
instruments: (1) A comprehensive search of published and unpublished studies was 
made through ERIC and similar Research bank's, m&stly through the computer search 
services of the San, Mateo County Schools Office. (2) A research assistant also 

o irs - ' ■ 
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conducted an independent search in tKe libraries of University of California, 
Berkeley, and California State University, Hayward, She set up research files, 
reviewed studies, and compiled abstracts and bibl iographies* (3) The mo$t pro- 
ductive method of obtaining recent information and unpublished techniques was to 
follow leads from Advisory Committee members and educators outside of Ccllifornia 
who had surveyed currenv act ices. Sin^e much of the information on development 
of needs assessment models and instruments is not in the literature, the best 
sources of information were key persons to whom I was referred* They in turn 
supplied more names, which I followed up. 

Collection of models and instruments . Kits and instruments of various kinds 
were ordered in October and November. Some were borrowed, some had to be pur- 
chased. Several of the most comprehensive ones did not arrive until December or 
January, and some materials ordered earlier have come as late as May. 

Site visit . It was not possible to make site visits to districts to observe 
the actual conduct of a needs assessment. However, I attended a national educa- 
tional needs assessment conference at Lake Buena Vista, Florida, sponsored by 



the conference was to demonstrate a computerized model developed by a consbr- 



college and university studies, which I incorporated in the report. I also dissem 
inated information about my own study. 

While in Florida I spent two days in Tallahassee, with Michael Knight 6f the 
• state department of education and Dr. Garret Foster of Florida State University, 
who have done considerable work on needs assessment. They supplied much infor- 
Nfiation whiah was useful In the report. 

Case studies . Case »-eports on six widely used and d'ifferent approaches were 

gathered through telephone interviews by a research assista.it, from lists of users 

j ' 

supplied by the developers . Supplementary infc-mation was contained in reports 



the Center for Community Needs As. cessment 




The purpbse 



tium of seven Florida corr^unity colleges. I obtained informatioti on community 
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and letters from the informants. The case studies in the first draft were then 
sent to the Informants for factual verification. In the final draft several studies 
were deleted, the others were connpletely rewritten in a more direct communicative 
Style, and information on results of the assessment was added. 

ANALYSIS PHASE 

Evaluative criteria . At- its first two meetings, the Advisory Committee reached 
a consensus on criteria for evaluating needs assessment models. I also examined 
criteria proposed by other researchers. These were all included in the first draft 
of the study, but viere integrated into one short list for the final report. 

jhese criteria were not the only basis for evaluating the advantages and dis- 
advantages of the models, however, because there is so much variation in'needs 
assessment techniques and in their implementation. Therefore, the criteria were 
supplemented by success and failure modes of analysis derived from a system approach. 
A modified Fault Tree Analysis was applied to a basic. needs assessment paradigm . 
consisting of four components, and the resulting strengths and limitations of var- 
lous models which were derived were incorporated in the study. 

Analysis of models . This occupied about three months. I examined all kits 
and models, read guidebooks and manuals, read reports of studies by other investi- 
gators, and suftimarized key descriptors on a master matrix. I then summarized the 
major advantages and disadvantages of each apprpach. 
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REPORT. PHASE 

First draft . The first draft (actually, my fourth), was sent to NIE on Feb- 
ruary 7, and was immediately reviewed by my Advisory Committee. Their recommenda- 
tions for deletions, revisions, and reorganization of the chapters were then inte- 
grated with the comments from the NIE reviewers for revision of the draft. 

A small subcommittee of the Advisory Committee met with me twice to assist 
with the revision, and to construct a matrix of model characteristics. 

ICO 



■^he final draft of the study represents a complete revision of the original. 
Stylistic changes were mad^i, theoretical material was greatly reduced, and-chapters 
on communication strategies and social falrnjess and bias were added. 

EVALUATION OF THE METHODOLOGY 

In general? the research methods and management scheme worked fairly well, but 
the process took much longer than I h^d anticipated. The acquisition of materials 
alone needed at least three months, and a comparable amount of time for reading and 
analysis. Although I had already conducted a preliminary search of the literature 
before submitting the proposal, I found that the really current material had to ^ 
found through non-trad i : ional research methods— mainly by relyi^ on a national net- 
work of informed educators. ^ 

If I were conducting the study again, I would make these changes: 

1. Have a much smaller Advisory Committee, with a larger proportion of them 
from outside California. They would meet oftener and assist more substantively 
with review of the materials. This would necessitate a larger budget,, of course. 

2. Keep a research assistant for the duration of th6 project, to track down 

Information., verify details, and assist with p-eparing copy for the secretaries. 

\ 

3. Send out a "user's survey" to a fair sampling of people yho have used 
major models, to verify actual practices. 

4. Have a clearer understand i,ng as to what is meant by an "Inter- 
pretive study." Although I believed that I was following the guidelines and was 
writing for the practitioner, my impression from the reviews was that the reviewers 
•did not really want an interpretive study of the research, but rather a manual on 
how to conduct a-needs assessment, which was not the original intent of the study. 
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